-- Logs begin at Sun 2022-08-07 18:37:47 UTC, end at Sun 2022-08-07 19:50:43 UTC. -- Aug 07 19:18:50.289989 dv-cinder-850320-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 19:18:50.297631 dv-cinder-850320-4-smb devstack@keystone.service[80280]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 19:18:50 2022] *** Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: nodename: dv-cinder-850320-4-smb Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: machine: x86_64 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: clock source: unix Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: pcre jit disabled Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: detected number of CPU cores: 4 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: current working directory: / Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: detected binary path: /usr/bin/uwsgi-core Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: your processes number limit is 47680 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: your memory page size is 4096 bytes Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: detected max file descriptor number: 2048 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: lock engine: pthread robust mutexes Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: thunder lock: enabled Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 19:18:50.302325 dv-cinder-850320-4-smb devstack@keystone.service[80280]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 19:18:50.342639 dv-cinder-850320-4-smb devstack@keystone.service[80280]: Python main interpreter initialized at 0x55cba3a529c0 Aug 07 19:18:50.342639 dv-cinder-850320-4-smb devstack@keystone.service[80280]: python threads support enabled Aug 07 19:18:50.342639 dv-cinder-850320-4-smb devstack@keystone.service[80280]: your server socket listen backlog is limited to 100 connections Aug 07 19:18:50.342639 dv-cinder-850320-4-smb devstack@keystone.service[80280]: your mercy for graceful operations on workers is 90 seconds Aug 07 19:18:50.343263 dv-cinder-850320-4-smb devstack@keystone.service[80280]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 19:18:50.343374 dv-cinder-850320-4-smb devstack@keystone.service[80280]: *** Operational MODE: preforking *** Aug 07 19:18:50.343706 dv-cinder-850320-4-smb devstack@keystone.service[80280]: *** uWSGI is running in multiple interpreter mode *** Aug 07 19:18:50.343706 dv-cinder-850320-4-smb devstack@keystone.service[80280]: spawned uWSGI master process (pid: 80280) Aug 07 19:18:50.343948 dv-cinder-850320-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 07 19:18:50.345222 dv-cinder-850320-4-smb devstack@keystone.service[80280]: spawned uWSGI worker 1 (pid: 80290, cores: 1) Aug 07 19:18:50.345381 dv-cinder-850320-4-smb devstack@keystone.service[80280]: spawned uWSGI worker 2 (pid: 80291, cores: 1) Aug 07 19:18:50.345491 dv-cinder-850320-4-smb devstack@keystone.service[80280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 19:18:55.924748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:18:55.924748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes Aug 07 19:18:55.925586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:18:55.925586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: from cryptography.utils import int_from_bytes Aug 07 19:18:55.926003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:18:55.926003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes Aug 07 19:18:55.926111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 19:18:55.926111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: from cryptography.utils import int_from_bytes Aug 07 19:18:55.976984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:18:55.977245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:18:55.977330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] command line args: [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:18:55.977626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:18:55.977778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ================================================================================ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:18:55.978067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] admin_token = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.978248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 19:18:55.978344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] config_dir = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.978453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 19:18:55.978539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.978644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] config_source = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.978752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] command line args: [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 19:18:55.978833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] debug = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.978905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 19:18:55.979023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ================================================================================ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 19:18:55.979361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_dir = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.979922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_source = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] debug = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_config_append = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.980985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_dir = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981216 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.981903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_config_append = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_dir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.982937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.983973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.984954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] publish_errors = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.985732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] publish_errors = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] standard_threads = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.986921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] use_journal = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] use_json = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] standard_threads = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] use_stderr = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.987807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] use_syslog = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.988582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_journal = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.988809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_json = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.988809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_stderr = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.989030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_syslog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.989279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 19:18:55.989501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.989957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.990972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.991894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.992983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.993900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.994932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.995933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.996904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.997944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.998922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:55.999963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.000971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.001967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.002981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.003890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.004930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.005939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.006966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.007898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.008927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.009897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.010944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.011919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.external = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.012947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.password = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.013986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.token = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.external = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.014934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.password = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.token = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.015973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.016934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.017966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.018918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.019895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.020887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.021905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.022880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.023888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.024991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.025928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.026903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.027937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.028860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.029907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.030979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.031898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.032920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.033907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.034903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.035995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.036898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.037914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.038950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.039967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.040962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.041975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.042995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.043894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.044906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.045923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] role.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] role.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.046912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.047901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.048958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.049842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.050847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.051980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.052975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.053999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.054984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.055901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.056917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.057939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.058974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.059979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.060921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.061977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.062815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:18:56.062928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.063040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.063207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.063447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.063692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.063930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 19:18:56.064106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 19:18:56.094439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.094690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.094861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.094954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.095021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.095223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.105996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.106329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.136053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.136460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.136460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.136668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.193636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.193833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.247751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.247980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.248108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.248268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.317994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.318569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.342165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.342372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.342621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.342818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.342961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.343838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.344116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.355334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.355641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.369317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.369517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.369748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.369975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.370327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.370555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.370775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.372101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.372338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.372562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.372785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.372998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.373218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.373432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 19:18:56.389130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.389431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 19:18:56.389717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.389906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 19:18:56.390185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.390449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.390721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.390968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.393244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.393469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 19:18:56.393821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.394024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 19:18:56.394305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.394561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.394825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.395089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.402628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.402920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.403222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.403518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.406872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.407158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.407456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.407743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.410562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.413694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.413972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.414264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.414553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.414741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.414930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.415121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.415383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.415663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.415938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.416217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.416491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.417808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.418092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.418379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.418664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.418964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.419237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.419520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.422813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.422813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.422813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.422813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.439637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.442961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.442961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.444274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.445741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.446044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.446875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.447176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.447487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.450674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.450963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.451281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.454159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.454453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.457989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.458285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.458581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.458879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.459180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.459506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.459791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.460075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.460355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.460627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.462437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.462735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.463022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.463488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.463622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.463920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.464215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.464496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.476740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.477034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.480648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.480939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.481053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.484285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.484594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.485040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.488240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.488536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.489007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.492228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.492965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.495386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.495691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.495979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.496163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.496277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.496557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.496839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.499482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.499793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.500096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.500385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.500669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.500958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.513161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.513460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.513720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.513990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.517137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.517446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.517713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.517974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.521024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.522643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.522901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.524924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.525764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.526058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.526344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.526527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.526620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.526768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.526884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.529590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.529895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.530253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.530528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.530842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.538391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.538689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.538973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.539276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.539561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.539843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.540122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.542246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.542542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.542825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.543100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.543411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.543692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.543983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.557061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.560085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.561020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.563080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.564107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.564713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.566213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.566486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.567160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.567440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.569043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.570546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.570839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.571140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.573643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.575294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.577720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.578278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.578593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.578894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.579181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.579363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.582313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.582592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.582891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.583170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.587243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.587545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.587835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.591239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.591545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.591825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.594760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.595053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.595367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.595650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.595919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.596213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.596490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.596787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.597170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.597465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.597738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.597992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.598271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.598532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.598777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 19:18:56.599074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.599387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.599666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.599946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.600234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.600515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.600791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.601181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.601471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.601751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.602018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.602299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.602564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 19:18:56.631987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cba3a529c0 pid: 80291 (default app) Aug 07 19:18:56.635566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28bca-6a0b-4762-9ff6-84acb53620e6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:18:56.635858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28bca-6a0b-4762-9ff6-84acb53620e6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:18:56.636008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cba3a529c0 pid: 80290 (default app) Aug 07 19:18:56.636146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde28bca-6a0b-4762-9ff6-84acb53620e6 None None] PATH_INFO: `/v3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:18:56.640590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sun Aug 7 19:18:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:04.491231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:04.491861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:04.491861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:04.496317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:04.503539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:04.504152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:04.504479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:04.581406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: INFO dbcounter [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] Registered counter for database keystone Aug 07 19:19:04.602931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG oslo_db.sqlalchemy.engines [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:19:04.609676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writer thread running {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:19:04.806650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG passlib.handlers.bcrypt [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80291) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 19:19:04.807029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG passlib.handlers.bcrypt [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80291) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 19:19:04.862870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:04.864675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:05.012869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 19:19:05.147847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:05.217229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: INFO dbcounter [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] Registered counter for database keystone Aug 07 19:19:05.239480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG oslo_db.sqlalchemy.engines [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 19:19:05.247255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writer thread running {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 19:19:05.364632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b932624-444a-407f-bbfa-ded82aad383f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:05.369440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:05.370079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:05.370358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:05.370624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:05.379737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:05.432101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 19:19:05.432101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f25f71-a799-4a66-b825-9fa8c32e16f7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:05.442800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Aug 7 19:19:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:19:05.449266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:05.464590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43742-8939-41ba-9f42-c761af7e0ce2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:05.469643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:05.470794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:05.471074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:05.471358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] PATH_INFO: `/v3/projects/e527c3fb15634bdca3cbcaa63266edf3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:05.472837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e527c3fb15634bdca3cbcaa63266edf3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:05.524140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 19:19:05.524870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ab8e-6044-46e8-a7aa-c7225eef01e0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:05.529306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sun Aug 7 19:19:05 2022] GET /identity/v3/projects/e527c3fb15634bdca3cbcaa63266edf3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:07.537715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48115e-e6da-43b5-93fe-f1bc93c69db0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:07.538247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48115e-e6da-43b5-93fe-f1bc93c69db0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:07.538391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48115e-e6da-43b5-93fe-f1bc93c69db0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:07.542786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:07.548946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:07.549483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:07.549483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:07.572052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:07.573765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:07.581939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 19:19:07.621174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48115e-e6da-43b5-93fe-f1bc93c69db0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:07.641830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48115e-e6da-43b5-93fe-f1bc93c69db0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:07.648908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:07.649930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:07.650414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:07.650900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:07.664838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:07.668246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5bce2-c2d3-4211-b4c0-17f4f0f40a88 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:07.684234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Aug 7 19:19:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:19:07.690378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:07.700510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55ff0d-a41f-4529-afac-d44966369d44 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:07.705426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:07.706077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:07.706355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:07.706629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:07.708120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:07.709973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6dd5f-5d62-4c61-ad65-42815494f8b0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:07.711588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sun Aug 7 19:19:07 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:09.883940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ab69-e379-4299-8a28-e1a03360aa24 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:09.884457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ab69-e379-4299-8a28-e1a03360aa24 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:09.884457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ab69-e379-4299-8a28-e1a03360aa24 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:09.885762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:09.891901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:09.892406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:09.892495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:09.912747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:09.913992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:09.966090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38079-0914-4641-ad71-554595d7c1e8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:09.966366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38079-0914-4641-ad71-554595d7c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:09.966651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38079-0914-4641-ad71-554595d7c1e8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:09.968138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:09.973716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:09.974002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:09.974279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.002144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:10.021489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80290) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 19:19:10.021974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80290) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 19:19:10.026159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.052637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.068977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:10.070711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:10.141606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573b20b-b86d-4002-85cf-6bff96ae756f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.180734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.181392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.181670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.181943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.189580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:10.194329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:10.203553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:10.204543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:10.205401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:10.211394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.226448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.324088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.329915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274212-d078-4bc0-9003-c0964048c911 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.332704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.347627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df989-26c8-446d-a7f9-dc6d976a9119 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.375292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.376171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.376451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.376886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.377741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:10.378038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.379686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.385015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.385654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.385932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.386206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.392358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:10.398027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.466291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.468028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.511053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40517323-28f5-4817-b4dc-800891f12111 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.551224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.552182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.552437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.552722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.554361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.555886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.557615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:10.568341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.617650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.676381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.699835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419758-3396-41b9-ad4d-4dd249b8c765 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.700605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:10.706613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.754098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.754754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.755029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.755340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.756536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.758001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.759639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:10.766042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.817999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63514577-6540-4d70-98fb-24f25d3eed1c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.852614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.853276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.853558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.853840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.865165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.866656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:19:10.883427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:10.884576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:19:10.885440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:19:10.885440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:19:10.885440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:10.885440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:10.885668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e83e-c9ca-4401-abb7-0403124a10bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:10.888233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:10.891949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:10.924967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:10.925592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:10.925869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:10.926132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:10.926923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.domain.id=default, user.id=3d7656c3347748588d850bcc8f38bb26) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:10.927170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:10.928678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c9c14-90f3-406a-aaba-796755db81e3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:10.938293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/role_assignments?user.id=3d7656c3347748588d850bcc8f38bb26&scope.domain.id=default&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 233 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:10.939117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:11.019107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b916-7851-4c6f-9514-77770466a573 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:11.061143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:11.061793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:11.062073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:11.062345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:11.063024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:11.063363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:11.064828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f491-ada3-479b-85a1-dedd04da4491 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:11.086028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:14.050746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d70-a80d-4789-b60b-1f41ca9f0765 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.052349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d70-a80d-4789-b60b-1f41ca9f0765 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.053144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d70-a80d-4789-b60b-1f41ca9f0765 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.055951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:14.064820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c953-5452-4436-9494-ffcec3b9e149 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.066248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c953-5452-4436-9494-ffcec3b9e149 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.067348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c953-5452-4436-9494-ffcec3b9e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.108816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0524c953-5452-4436-9494-ffcec3b9e149 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:14.111591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0524c953-5452-4436-9494-ffcec3b9e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:14.277027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:14.312147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306d70-a80d-4789-b60b-1f41ca9f0765 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:14.312991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7a12-dab1-4ab9-a8cb-9f6702209d9b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.317116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7a12-dab1-4ab9-a8cb-9f6702209d9b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.317116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7a12-dab1-4ab9-a8cb-9f6702209d9b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.317615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:14.326575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e077cb-b0b5-420f-823d-2607ddedf37d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.327062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e077cb-b0b5-420f-823d-2607ddedf37d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.327574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e077cb-b0b5-420f-823d-2607ddedf37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.362022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-36e077cb-b0b5-420f-823d-2607ddedf37d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:14.364075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-36e077cb-b0b5-420f-823d-2607ddedf37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:14.395910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:14.497579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:14.504540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53efc4-2185-401a-9957-555a8d78acf2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.505313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53efc4-2185-401a-9957-555a8d78acf2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.505941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53efc4-2185-401a-9957-555a8d78acf2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.509273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:14.515813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.516610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.517305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.573559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:14.575917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:14.650440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306d70-a80d-4789-b60b-1f41ca9f0765 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:14.706296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:14.707424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:14.717528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:14.719542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.720122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.720694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.752826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:14.754844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-243d1cc6-d25e-43f8-999d-09dea1966c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:19:14.779362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:14.780608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:19:14.781705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:19:14.781705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:19:14.781705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:14.783419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 13/28] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:14.785230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2b62-e484-42a0-882e-2f1546c07614 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.785667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2b62-e484-42a0-882e-2f1546c07614 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.786077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf2b62-e484-42a0-882e-2f1546c07614 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.787693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 14/29] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:14.792850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2b62-e484-42a0-882e-2f1546c07614 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:14.817646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:14.828883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:14.842909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ccfd6-33db-49cd-a61b-4c7aacfd3ddf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:14.881442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:14.882510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.883062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.883740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.895681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:14.901248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:14.902160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:14.902935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:14.905909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 16/30] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:14.907401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:14.920446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf2b62-e484-42a0-882e-2f1546c07614 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:14.960910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:14.961540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:14.962071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:14.962490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:14.963452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:14.965280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.033574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82cf3c-ba90-4bc4-b8ec-c838c350d816 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:15.091831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:15.093680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.094211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.094731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.095699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:15.096254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:15.098002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec553d-e0cc-408c-ae5e-e7ba57a0ac5e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.115139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 17/31] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:15.116958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.117535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.118014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.129429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:15.144739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:15.146402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:15.260548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 15/32] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 19:19:14 2022] POST /identity/v3/roles => generated 219 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:15.260548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:15.263574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:15.264602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:15.458909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7875c7-d71a-4fb2-8e21-a2cca923e086 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:15.486782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:15.505344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:15.505986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.506260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.506528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.507184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:15.509269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.516434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:15.519375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40751-e7f9-4dd5-8746-8c760af78740 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:15.567988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:15.569200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.569689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.570175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.571272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:15.571848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:15.573861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.586340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 16/34] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:15.587751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:15.674470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 19/35] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:19:15 2022] POST /identity/v3/projects => generated 301 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:15.676031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:15.716289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e38f-07c0-402a-b812-e9b38094fa3f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:15.786723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:15.787450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.787736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.788015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.789370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:15.790833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17999c7-8d8d-4693-957b-ac1a56d2f636 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.811219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:15.820738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 17/36] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 19:19:15 2022] POST /identity/v3/roles => generated 225 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:15.839262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2db52-bbf8-42cf-8f27-16656366ac00 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:15.880745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab565-957e-4208-a6db-d1dfdd708bd1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.881091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab565-957e-4208-a6db-d1dfdd708bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.881378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab565-957e-4208-a6db-d1dfdd708bd1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.883282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:15.886715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:15.887902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.888423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.888926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.890740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:15.890892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:15.891179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:15.891557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:15.893283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:15.895486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:15 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:15.904031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:15.940762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:15.943099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:15.998629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:16.067804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:16.068691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af94f5-4d04-49af-bba6-b799fd3277cf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:16.109310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:16.109525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:16.110210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.110387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.110673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.112006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:16.113911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:16.115892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 21/40] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:16.125010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:16.271151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233e04-e66f-4bf9-be82-d90a57fc62a2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:16.302362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:16.308700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:16.309353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.309633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.309905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.310609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:16.312128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53352405-ca71-4989-882f-61ce27f9a78b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:16.315392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d6f5a-6a7e-42e9-b549-36dd017bb4da None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:16.328232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 19:19:16 2022] POST /identity/v3/roles => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:19:16.329495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62545f8-4902-4ef2-b974-e0e8b2474853 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.329840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62545f8-4902-4ef2-b974-e0e8b2474853 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.330123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62545f8-4902-4ef2-b974-e0e8b2474853 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.331565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 21/42] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:16.337630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.337965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.338572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.345675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:16.359387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:16.360702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:16.361462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:16.362241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.362647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.362887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] PATH_INFO: `/v3/domains/default/users/3d7656c3347748588d850bcc8f38bb26/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.366547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3d7656c3347748588d850bcc8f38bb26, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:16.368286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:16.386599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1361 bytes} [Sun Aug 7 19:19:16 2022] PUT /identity/v3/domains/default/users/3d7656c3347748588d850bcc8f38bb26/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:16.479231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:16.495599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:16.637397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3985a-a9ad-4fcd-aacf-dfae9c6ca48c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:16.674369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:16.675056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.675383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.675660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.676869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:16.678435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45643b92-60bf-4786-a41b-60ef445be85e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:16.680276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 23/45] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:16.686934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:16.799780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba293-e851-4890-a89c-06072e098bd7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:16.822266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:16.846527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:16.847916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:16.848430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:16.848926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:16.850215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:16.853084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b4661-cc49-4959-8d45-a5e593ddae28 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:16.900110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:19:16 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:18.466274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d069c7-02f3-42b3-b8c6-96da7634923d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:18.466880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d069c7-02f3-42b3-b8c6-96da7634923d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:18.466880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d069c7-02f3-42b3-b8c6-96da7634923d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:18.468330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:18.474006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:18.474561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:18.474561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:18.494468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:18.495758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:18.567965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:18.591631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d069c7-02f3-42b3-b8c6-96da7634923d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:18.651920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:18.709943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d069c7-02f3-42b3-b8c6-96da7634923d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:18.748141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:18.748910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:18.749193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:18.749470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:18.761114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:18.765964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:18.766913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:18.768290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:18.773604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:18.890511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f53b3-31e6-4b7b-a9d7-ddf5711887e9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:18.892224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:18.928443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:18.929093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:18.929381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:18.929652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:18.930363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:18.930669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:18.932139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b94c33-9419-4c9f-899e-7bb23a806202 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:18.941623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:18.947692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:18.997649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b340-bfce-42ac-909a-e41f590cc6b9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:18.997649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b340-bfce-42ac-909a-e41f590cc6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:18.998271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b340-bfce-42ac-909a-e41f590cc6b9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:18.999619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 26/51] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:19.005475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.005799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.006070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.026699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:19.028264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:19.072328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e571c4-e66b-4456-aa51-3e7a5ccca65a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:19.083916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:19.108430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:19.109112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.109388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.109659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.110843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:19.112378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:19.114061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:18 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:19.119762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:19.122401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:19.147546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:19.231808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc260-ddcf-4c94-9421-846e9648b342 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:19.255276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:19.264860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050240c-a6d3-43e8-a3ba-5fb7bfbb5850 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:19.268122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:19.268804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.269078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.269350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.270608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:19.272037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:19.273712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:19.279867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:19.305831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:19.306519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.306801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.307082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.308302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:19.309810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:19.311565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:19.318076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:19.336657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:19.396503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5cc97-a0ef-447a-9536-d08a896238fc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:19.440842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:19.441827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.442114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.442391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.443158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.domain.id=default, user.id=3d7656c3347748588d850bcc8f38bb26) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:19.443500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:19.445023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40a32-553f-470d-90a9-27b771c67f25 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:19.451425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7568ed1-725f-451e-a420-2449df0b053f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:19.453262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Aug 7 19:19:19 2022] GET /identity/v3/role_assignments?user.id=3d7656c3347748588d850bcc8f38bb26&scope.domain.id=default&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 530 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:19.508895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:19.509518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:19.509735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:19.510008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:19.510698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:19.512284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7521c11-8942-467b-827d-a98a931dad19 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:19.546207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 29/57] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Aug 7 19:19:19 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:19:21.576613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69747-0d40-4fdd-9ac4-90bd71491dea None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:21.577172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69747-0d40-4fdd-9ac4-90bd71491dea None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:21.577286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc69747-0d40-4fdd-9ac4-90bd71491dea None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:21.578582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:21.584139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:21.584598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:21.584683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:21.603860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:21.605090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:21.615143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:21.674621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:21.699522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69747-0d40-4fdd-9ac4-90bd71491dea None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:21.808107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc69747-0d40-4fdd-9ac4-90bd71491dea None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:21.819163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:21.845798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:21.846446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:21.846725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:21.846993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:21.848172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:21.849621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3875f7-afcc-43ab-b125-a866438e6f3b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:21.851209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:21.857175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:21.961181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e10b9-56a6-49c6-b2f1-4bba5505dd73 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:21.996668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:21.997295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:21.997572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:21.997848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:21.998627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:22.000136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a294ae7-726c-49e5-9172-cfb4457eba27 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:22.028080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:22.041004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:21 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:19:25.233815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcd62-0678-4b76-98fc-761cb1e4cd14 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.235421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcd62-0678-4b76-98fc-761cb1e4cd14 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.236180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcd62-0678-4b76-98fc-761cb1e4cd14 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.238778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:25.244561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.245325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.245325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.272760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:25.274016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:25.388674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:25.432928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bcd62-0678-4b76-98fc-761cb1e4cd14 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:25.557301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bcd62-0678-4b76-98fc-761cb1e4cd14 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:25.609170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:25.609845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.610130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.610409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.625184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d387a298-6272-42a4-b2ca-d220f60ef2db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:25.630629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:25.631561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:25.632315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 32/64] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:25.637930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:25.780433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3813-f9a2-45fb-863c-ad646e925b7b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.780810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3813-f9a2-45fb-863c-ad646e925b7b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.780984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3813-f9a2-45fb-863c-ad646e925b7b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.782378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 33/65] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:19:25.790226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7e78-7af0-48c9-80fa-0a73a3df0ce6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.790519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7e78-7af0-48c9-80fa-0a73a3df0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.790773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad7e78-7af0-48c9-80fa-0a73a3df0ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.796887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf7ac-5d0e-4ca0-9944-b91d1d956e1d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:25.815027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b8ad7e78-7af0-48c9-80fa-0a73a3df0ce6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:25.817226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b8ad7e78-7af0-48c9-80fa-0a73a3df0ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:25.845609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:25.852901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:25.853578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.854164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.854561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.855136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:25.855497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:25.857504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b4af-0e94-4400-9d24-c6dc43d79145 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:25.867863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 33/66] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:25.872760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:25.873083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed0db-735e-4a90-bc1c-787e58dd1aa0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.873477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed0db-735e-4a90-bc1c-787e58dd1aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.873773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed0db-735e-4a90-bc1c-787e58dd1aa0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.875824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 34/67] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:25.876940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ed0db-735e-4a90-bc1c-787e58dd1aa0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:25.930651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:25.932507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:25.932836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:25.933071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:25.952739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:25.954061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:26.037912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:26.039367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.053290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ed0db-735e-4a90-bc1c-787e58dd1aa0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.122547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.123138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.123633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.124208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.151518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:26.154980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:26.158065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 35/70] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:25 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:26.158903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.220145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.225510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b26b3a-2641-4e8a-b5ad-700bf24e7b21 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.265624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.281673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.283754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.284475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.285119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.304153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:26.310635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:26.312334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:26.313829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:26.315422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:26.317279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.346464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106815-e3c6-4ade-9784-d0ddbdd9438e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.395633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.396181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.396451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.396729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.410933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-198ab16f-ce43-4b07-aae1-d1064df65796 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:26.417941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:26.426284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 36/72] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:26.427665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b78ab-d382-4fcc-8495-8436b174e6b5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.428855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b78ab-d382-4fcc-8495-8436b174e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.428855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b78ab-d382-4fcc-8495-8436b174e6b5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.428855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 37/73] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:26.428855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b78ab-d382-4fcc-8495-8436b174e6b5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.485692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722fbd7-e43b-4f9b-a85e-3cf0dac2a20c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.531735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.534076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.534076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.534076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.558710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b78ab-d382-4fcc-8495-8436b174e6b5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.563973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.570790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.612425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:26.613934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ecd47-d694-4a76-a6bd-5ee4e04fdf3a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:26.619980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.620622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.620976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.621434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.622255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:26.622566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:26.624283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:26.634096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:26.635173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.728570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 37/75] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:26.730207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1714c-88be-4011-8caa-7d95e3841d1c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.730492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1714c-88be-4011-8caa-7d95e3841d1c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.730770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1714c-88be-4011-8caa-7d95e3841d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.757752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-85f1714c-88be-4011-8caa-7d95e3841d1c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:26.759461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-85f1714c-88be-4011-8caa-7d95e3841d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:26.791412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734331b-177f-42bb-810c-f3c0e375ed84 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:26.827990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.833688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:26.834784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.835347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.835856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.837111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:26.837508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:26.838963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:26.852845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 38/76] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:26.853098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:26.853240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846874cc-c283-412d-927a-6cae7d6d6499 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:26.853240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846874cc-c283-412d-927a-6cae7d6d6499 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:26.855403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.855483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846874cc-c283-412d-927a-6cae7d6d6499 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:26.855483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 39/78] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:26.855483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846874cc-c283-412d-927a-6cae7d6d6499 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:26.902733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:26.998435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846874cc-c283-412d-927a-6cae7d6d6499 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.006636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808028fc-50cc-4a6e-a7b4-30e2b6a496b6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.047382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.048264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.048647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.049024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.050652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.052874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.054627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.063856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:27.064092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.064092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.064092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.064391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd327dc-ce63-40de-a3c0-0f1855356af6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:26 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.064517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.083036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:27.084352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:27.148769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.196104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:27.197595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.204592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771a2d9-a2c4-49f8-bdc0-40dd40d97a46 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.233795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.247296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.248028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.248401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.248866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.250054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.251567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.253271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:27.254409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.344468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d52d9-54fa-4d69-a069-43d6376929b6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.375784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5038e6e-b816-4e50-8e8f-be1d91230de7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.405656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.420909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.421637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.421809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.421929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.422083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.424665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.424770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:27.424770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.424939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.424939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.425079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.426677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.428784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.430694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:27.431301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.432621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 42/84] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:27.435041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.566798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.574579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ee95d-d9ae-4c04-b302-d37c67a87c3b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.626786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7cd79-bb0e-4853-b232-1eb1da5d5d48 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.629238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.630214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.630653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.632266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.713118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.714582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.715162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.715600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:27.730447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:27.735492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:27.736378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:27.737284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:27.738075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:27.738714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:27.743333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.810488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.891878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:27.901716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 43/86] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:27.901925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917942-4a41-4814-9019-fd056c9d485a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:27.902021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:27.969314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:27.970480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:27.970973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:27.971504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.042229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997c22-2584-44cf-a50f-16fb70df0e73 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.075399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.077285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.104202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.105245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.105906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.106397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.107580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.110489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.151342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 44/87] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:27 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:28.151342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.181931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.255322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.295851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 44/88] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:28.297026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.334447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618a17-1894-4fc2-a995-25faed9797bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.389017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.390020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.390020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.390256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.391143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:28.391524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.404180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.417764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 45/89] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:28.425019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.462474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809ed3-2ef1-4584-9c48-2e9e8e05d1be None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.530383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.531436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.531716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.531987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.535106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.537965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.541291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:28.542559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.588207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed7f18-ee2d-4ad3-8ab4-5cb5588777ba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.601024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.631633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.666482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.667480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.667950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.668408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.670441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.672665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.676920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:28.678404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.727078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef31dd3-dd89-4a1b-af7d-96b9f5d9a90b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.792297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.793316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.793741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.794184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.796879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.799828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.803588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:28.812593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.818187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245e5c-0815-405c-866f-0783ac1dbd32 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:28.869250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:28.870343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:28.870918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:28.871400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:28.873731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=3d7656c3347748588d850bcc8f38bb26) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:28.873731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:28.875514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:28.885137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/role_assignments?user.id=3d7656c3347748588d850bcc8f38bb26&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:28.886078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:28.958334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.973567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:28.990683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d029-c22a-4ce0-85f7-d57b9f62cdde None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:29.057449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:29.058883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:29.059557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:29.060343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:29.062051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:29.062770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:29.071683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:29.082237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=070fb9808a24437b8676aa149373541e => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:29.101543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8816d5-59d0-46c6-ad2b-e5bfffe16a62 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:29.159826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:29.160510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:29.160759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:29.161018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:29.239136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:29.240601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:29.300688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:29.394755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 48/95] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:29.404447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:29.641764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e06ea7-fbed-4497-a56b-bbc5b34c857a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:29.697141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:29.697813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:29.698095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:29.698368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] PATH_INFO: `/v3/projects/7e473477202a42d2b42512f270385656` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:29.699890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] RBAC: Authorizing `identity:get_project(project_id=7e473477202a42d2b42512f270385656)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:29.701498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37e5d-254b-4003-aff6-e0532edeb099 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:29.703714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:29 2022] GET /identity/v3/projects/7e473477202a42d2b42512f270385656 => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:29.713410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:29.930664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcea18-1ee6-4f59-b2d2-b4c18f55dec1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:29.990774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:29.991732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:29.992124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:29.992562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:29.993643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=7e473477202a42d2b42512f270385656, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:29.994082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:29.996307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cee2e-f21c-47e8-b7b2-5ce18578bc91 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:30.009513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:29 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=7e473477202a42d2b42512f270385656&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:30.434936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7f2-fac8-4e74-a787-9335f8b50c9a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:30.435408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7f2-fac8-4e74-a787-9335f8b50c9a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:30.435753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1a7f2-fac8-4e74-a787-9335f8b50c9a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:30.438072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:30.445687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:30.446977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:30.447638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:30.488401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:30.490462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:30.519883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:30.631262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:30.675843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a7f2-fac8-4e74-a787-9335f8b50c9a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:30.703821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:30.861424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1a7f2-fac8-4e74-a787-9335f8b50c9a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:30.926265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:30.927287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:30.927696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:30.928086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:30.948788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:30.956791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:30.957679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:30.958436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 50/100] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:30.966221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:31.117017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d5b96-5348-41c9-8895-092c1b45cdfd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:31.174208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:31.174861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:31.175144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:31.175456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:31.176964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:31.177274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:31.178711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:31.188609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 51/101] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:31.194760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:31.311268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:31.361855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfba0a-7ab9-48e1-849b-0472337fd90c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:31.446949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:31.448113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:31.448608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:31.449099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:31.451180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:31.454092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:31.457605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:31 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:31.466802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:31.484856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:31.656338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771fe9-9cdc-47a1-a5a5-9ad7b6398e7b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:31.711746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:31.712872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:31.713386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:31.713903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:31.716156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:31.719177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a718e9-1bea-4953-b8b5-07fb6154aee2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:31.724217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:31 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:31.730987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:31.864123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e02453-896b-429b-aa62-1c30f90ebe64 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:31.909669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:31.910279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:31.910562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:31.910831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/2299e2d24b15412c94b8944dc0ab1c99/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:31.916612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, user_id=2299e2d24b15412c94b8944dc0ab1c99, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:31.918130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b29850-1203-4585-bfdf-3c1b27823e42 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:31.946054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 52/104] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:31 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/2299e2d24b15412c94b8944dc0ab1c99/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:32.251449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403467c-53fc-4925-a999-fb2ac670294c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.251962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403467c-53fc-4925-a999-fb2ac670294c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.252379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403467c-53fc-4925-a999-fb2ac670294c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.255290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 53/105] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:32.255474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfc7cc-e001-4394-81ce-ba8adc4ae45d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.255474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfc7cc-e001-4394-81ce-ba8adc4ae45d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.255954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfc7cc-e001-4394-81ce-ba8adc4ae45d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.257798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 53/106] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:32.264335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.264825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.265312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.301111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.301538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.301682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.306943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:32.308793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:32.326082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:32.339709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:32.344054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:32.489045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:32.504692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 54/108] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:32.520580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:32.530829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:32.569440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:32.766795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ea67f-205e-447e-8876-7459c68b463d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:32.844116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:32.844860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.845138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.845405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.864351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a36b0-7d40-41d1-ac9c-548646ef136a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:32.886828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:32.902132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:32.903862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:32.905565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:32.909182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 55/109] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:32.937962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:32.971239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:32.973489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:32.974857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:32.975520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:32.982207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.000923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-28ab9991-1959-42ba-83d7-22d30bed5f6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:33.010001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:33.011741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:33.012718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 55/110] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:33.014834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04c5-2446-407d-a2d1-fa9c29347b84 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.015483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04c5-2446-407d-a2d1-fa9c29347b84 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.016544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04c5-2446-407d-a2d1-fa9c29347b84 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.020237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 56/111] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:33.022178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac04c5-2446-407d-a2d1-fa9c29347b84 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.062913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.143871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ec80c-4116-407b-bf14-10f6ccde40d0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:33.207153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:33.208506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.209203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.209833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.211255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:33.211944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:33.214873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac04c5-2446-407d-a2d1-fa9c29347b84 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:33.215113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ff4b-cf28-4a5d-95a4-0903df58fc4a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:33.234360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 56/112] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:33.234360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c87d-17db-4ad4-8354-2ac9fbdd36f9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.234360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c87d-17db-4ad4-8354-2ac9fbdd36f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.234360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c87d-17db-4ad4-8354-2ac9fbdd36f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.259406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:33.260277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.260717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.261127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.261992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:33.262469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:33.263872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6471c87d-17db-4ad4-8354-2ac9fbdd36f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:33.264545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2695e8-b1c7-4d3c-9555-94f4e9130c51 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:33.266119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6471c87d-17db-4ad4-8354-2ac9fbdd36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:33.286342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 57/113] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:33.288680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5071-148e-489c-af9d-569f1c71a206 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.289318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5071-148e-489c-af9d-569f1c71a206 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.289982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5071-148e-489c-af9d-569f1c71a206 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.292685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 58/114] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:33.294033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5071-148e-489c-af9d-569f1c71a206 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.409550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:33.412514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.415548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.416837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.417678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.457397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:33.461465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:33.503041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5071-148e-489c-af9d-569f1c71a206 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:33.530917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.559757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:33.560957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.592904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:33.594751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.595700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.596415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.599434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:33.603438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:33.608571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 59/117] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:33.610922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.713628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7b70-60cb-4b18-95d2-d1ac8520b5cc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:33.784371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:33.786794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.787579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.788281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] PATH_INFO: `/v3/users/12a8a9ef0d924044a524aa31f3a81752` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.814489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] RBAC: Authorizing `identity:get_user(user_id=12a8a9ef0d924044a524aa31f3a81752)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:33.817697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:33.820680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 59/118] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/users/12a8a9ef0d924044a524aa31f3a81752 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:33.821555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.829037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24544-aba6-416d-bdbe-6203e888baef None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:33.858767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.874334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:33.876254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:33.876735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:33.877011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:33.890194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:33.900842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:33.901784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:33.902571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:33.903325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 60/119] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:33.904795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:33.905412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:33.974682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e689fdb-22b8-473c-b4b7-9e9d4bfb8cfc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.022443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.023401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.023774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.024147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.025919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.028353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.035319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 60/120] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:34.035319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.075913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26873c-20d3-4ab7-b952-03de3ee2bbb7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.129102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.129914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.130195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.130473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.131867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.133519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee920ee-a55c-4acc-9ffa-0b40b7608cf1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 61/121] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:33 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e2b1-8e2c-427d-8222-7ed786383ab0 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e2b1-8e2c-427d-8222-7ed786383ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e2b1-8e2c-427d-8222-7ed786383ab0 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 62/122] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:34.141195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e2b1-8e2c-427d-8222-7ed786383ab0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.208394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.230448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29c60-f1d1-49c3-bd27-11f0bcbe5ab1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.256898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.275779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e2b1-8e2c-427d-8222-7ed786383ab0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.289179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.289895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.290213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.290502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.332177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.332814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.333096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.333365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.334056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:34.334365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.335913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.346031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:34.346919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.393776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.396577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.488219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a99a4-9b3c-4efd-bef1-e2286613078a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.510549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.542758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.543629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.543968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.544305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.545101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.547082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85964ccf-4101-4264-a390-820eb1c82d21 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.549536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 61/124] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:34.550384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.576648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.585702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 64/125] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:19:34 2022] POST /identity/v3/projects => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:34.587059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.587373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.587653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.619221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:34.627224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:34.687004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6722b-3378-4345-83ae-e6830b5ac1e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.712932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 65/126] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:34.712932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.734740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.735912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.736792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.737306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/3d7656c3347748588d850bcc8f38bb26/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.741104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, user_id=3d7656c3347748588d850bcc8f38bb26, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.743518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775cc4c-fe7f-4ec6-88b5-c439e8171e66 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.764478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 62/127] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:34 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/3d7656c3347748588d850bcc8f38bb26/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:34.766250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29cc4-9b03-4138-be02-488008fdc236 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.766856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29cc4-9b03-4138-be02-488008fdc236 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.767359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f29cc4-9b03-4138-be02-488008fdc236 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.769441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 63/128] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:34.770528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f29cc4-9b03-4138-be02-488008fdc236 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.882662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.885801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:34.894852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf3030-eebe-45c2-8da6-be432fed0fdb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:34.943956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:34.944631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:34.944904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:34.945169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:34.946368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:34.947878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:34.949685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:34 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:34.950297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:34.970175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f29cc4-9b03-4138-be02-488008fdc236 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.039032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.040127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.040570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.041019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.042908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:35.045584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f0da2-5334-4cb6-84dd-6354c3d5d2ae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:35.048457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 64/130] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:34 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:35.050355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.050801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.051258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.083034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:35.085062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:35.110985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ac3b-02b4-49b3-b379-4acbcaddf134 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.174984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.176156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.176608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.177072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.197564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:35.200351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 65/131] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:35.201834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:35.207110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:35.208002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:35.208752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:35.209333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 67/132] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:35.215222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.245403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:35.312312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:35.334365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ccd86-3474-4c4c-8dad-2898c4226b6f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.344917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf667d0-7aec-4b79-97bf-daed0c8b899c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.381721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.382738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.383407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.383860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.385183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=12a8a9ef0d924044a524aa31f3a81752) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:35.386030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:35.388689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:35.399775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 68/133] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/role_assignments?user.id=12a8a9ef0d924044a524aa31f3a81752&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:35.411242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.415956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.417726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.418625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.419361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.428813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:35.432126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:35.435676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 66/134] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:35.437569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.567627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:35.574303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cec34-0681-4f30-a828-5df304d0cc6b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.614290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.617717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.617717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.617717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.617717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:35.617717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:35.618931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:35.629307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 69/135] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:35.630079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.676113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f19f9d-321b-414c-9f74-6e24d743ede2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.748696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d30e-cf6d-4fbb-8853-0532a6e51ee7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:35.755957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.756639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.756920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.757197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.774652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:35.789171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:35.790222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:35.790699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:35.791185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/2299e2d24b15412c94b8944dc0ab1c99/roles/070fb9808a24437b8676aa149373541e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:35.791589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:35.793976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, user_id=2299e2d24b15412c94b8944dc0ab1c99, role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:35.795834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:35.800764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:35.801874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:35.802656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:35.812387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 67/136] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:35.815592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.818330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 70/137] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:35 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/2299e2d24b15412c94b8944dc0ab1c99/roles/070fb9808a24437b8676aa149373541e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:35.821009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:35.856692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:36.116986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c56bc-4c20-43e6-b2fe-096744a7d41d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.124596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf41be-a5b2-449c-824e-237f0f445d52 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.160927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.161566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.161848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.162130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.162818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:36.163135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.165204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:36.176161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 71/138] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:36.181827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:36.190358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.191602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.191887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.192159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.193631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.196066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:36.198361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 68/139] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:35 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:36.204798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:36.297022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:36.302694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:36.411903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f50c-7dde-4dac-8ba3-a62b0ec75e8b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.436008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e6f-e500-4a34-85f4-5cde2ea823eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.514166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.514886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.515163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.515455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.517174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.518641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:36.520277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 72/140] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:36 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:36.524175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.524907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.525836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:36.526877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.531084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] PATH_INFO: `/v3/projects/7e473477202a42d2b42512f270385656` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.538800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] RBAC: Authorizing `identity:get_project(project_id=7e473477202a42d2b42512f270385656)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.540386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:36.542615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 69/141] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:36 2022] GET /identity/v3/projects/7e473477202a42d2b42512f270385656 => generated 312 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:36.565231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:36.708892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2372-c821-4dd0-8257-42b14dbcd9d5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.781726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.782495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.782878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.783262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.784101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1497c6-0ab5-4798-9ffb-b9ee8498d228 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:36.819554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:36.883708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:36.884546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:36.884826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:36.885225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] PATH_INFO: `/v3/projects/7e473477202a42d2b42512f270385656/users/2299e2d24b15412c94b8944dc0ab1c99/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:36.893928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e473477202a42d2b42512f270385656, user_id=2299e2d24b15412c94b8944dc0ab1c99, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.895797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:36.899505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:36.931306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 70/142] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:36 2022] PUT /identity/v3/projects/7e473477202a42d2b42512f270385656/users/2299e2d24b15412c94b8944dc0ab1c99/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:36.959634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:36.961059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:37.105967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:37.111971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:37.257621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ddda-92e7-49d0-bc85-95c6e2124b51 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:37.301166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:37.302257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.302751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.303279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.304789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:37.306599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a82b33-0b86-405e-a6f1-87e042350f57 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:37.309121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 71/144] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:37 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:37.316059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:37.352727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd8eac-0a33-4c27-8d24-1edeef2ef3ae None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.353371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd8eac-0a33-4c27-8d24-1edeef2ef3ae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.353867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd8eac-0a33-4c27-8d24-1edeef2ef3ae None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.355583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 72/145] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:37.361389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.362034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.362527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.384044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:37.385732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:37.444140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:37.465961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:37.483369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:37.508581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:37.595498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7850a-10d9-4828-96f0-d95c89cf2297 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:37.621050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10950c9-b934-4827-9f03-2142af1ddb9c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:37.659698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:37.660720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.661194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.661690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.663173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:37.664887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:37.666865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 74/147] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:37.672717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:37.674787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:37.675458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.675740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.676016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.676927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:37.677115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:37.679005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231efe75-ec3a-4fa0-b2f2-75985e65629a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:37.693871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 74/148] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:37 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:37.713701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09384-1a8f-4ba6-9a61-f503435eeb9e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.714040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09384-1a8f-4ba6-9a61-f503435eeb9e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.714278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c09384-1a8f-4ba6-9a61-f503435eeb9e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.717380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 75/149] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:37.722014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:37.722304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:37.722591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:37.748501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:37.749776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:37.751668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:37.867246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8f91-341a-40f0-878e-181d43690af9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:37.951586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:37.989489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:37.999912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:38.000550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.000822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.001086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.001750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:38.003225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:38.048046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 75/151] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:37 2022] POST /identity/v3/users => generated 283 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:38.085325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:38.197323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688142b-5287-4c1c-96a0-c4969c4a3d6a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:38.240611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:38.241645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.242109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.242561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.257763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:38.263219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:38.264170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:38.265001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:38.267460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:38.274458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:38.404017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f380-e5be-491f-a28f-8552bc8da90b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:38.426166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:38.455430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:38.456044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.456324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.456594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.457290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:38.457593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:38.458992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:38.470526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:38.476120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:38.600901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:38.608885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be987-1f6f-45e5-a9bd-65a21b2ca0f9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:38.660556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:38.661421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.661755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.662024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] PATH_INFO: `/v3/users/3d7656c3347748588d850bcc8f38bb26` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.664965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] RBAC: Authorizing `identity:get_user(user_id=3d7656c3347748588d850bcc8f38bb26)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:38.667861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f3965-a585-47ae-a650-f300dcb0abfd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:38.671298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 78/154] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:38 2022] GET /identity/v3/users/3d7656c3347748588d850bcc8f38bb26 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:38.676894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:38.831783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95eb1-3f59-4445-994d-c3f52d4da09a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.832141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95eb1-3f59-4445-994d-c3f52d4da09a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.832515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95eb1-3f59-4445-994d-c3f52d4da09a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.834171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 79/155] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:38.844784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf45c-e3e6-435f-bd7b-4e9880f3ef5c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.845075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf45c-e3e6-435f-bd7b-4e9880f3ef5c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.845322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf45c-e3e6-435f-bd7b-4e9880f3ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:38.880078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce92e6-fd2d-4bfe-8dea-e5f63d4133ac None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:38.880705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-031cf45c-e3e6-435f-bd7b-4e9880f3ef5c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:38.881456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-031cf45c-e3e6-435f-bd7b-4e9880f3ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:38.941576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:38.943121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:38.943911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:38.944599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.013838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 80/156] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:39.037185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee435b5-69c3-477c-a59b-0536b0c9157e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.037619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee435b5-69c3-477c-a59b-0536b0c9157e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.038079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee435b5-69c3-477c-a59b-0536b0c9157e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.040670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 81/157] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:39.053790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.056599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.056599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.066938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.097550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:39.099392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:39.101016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:39.103020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:39.261871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 82/158] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:39.265142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.267827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 77/159] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:39.274668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.309295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.427450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.428722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd41cc3-a39d-4cb3-9b30-2e9cecdfebe6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:39.469716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634849ac-d38e-4e55-b0df-190b2b8d626a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:39.505233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:39.505943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.506169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.506435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.524101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:39.529225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:39.530507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:39.531413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 83/160] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:39.532061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.538149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:39.538826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.539109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.539410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.543073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:39.544592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:39.546882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 78/161] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:39.547715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.625286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.647252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45c3b-25f0-462d-8d23-c0a530d10c08 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:39.684317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:39.685286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.685706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.686199 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.698744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:39.704287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:39.705463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:39.706424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:39.707075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b4a5f-8035-43be-be24-cd5d47226d6c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:39.708516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 84/162] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:39.709467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.767698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:39.768326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.768599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.768869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.769550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:39.769850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:39.771461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:39.790225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 79/163] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:39.791049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.814015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.826227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28362d-48f7-45f5-b663-8250ddfadd17 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:39.873584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:39.875435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:39.876302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:39.877128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:39.879136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=3d7656c3347748588d850bcc8f38bb26) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:39.880065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:39.883586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:39.893553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 85/164] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/role_assignments?user.id=3d7656c3347748588d850bcc8f38bb26&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:39.895210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:39.906085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:39.964935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e87a9-ec34-4313-8d05-74f02c78935c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.021075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.021717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.022003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.022289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.022950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:40.023280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.024807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.036747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceacbf9-a3af-4bcd-afa6-9d053041be0b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.043175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 80/165] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:40.049219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.081555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.082667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.083172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.083700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.085392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.087274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.089916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 86/166] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:39 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:40.097062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.213294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:40.245314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22912a-ae60-4aea-90e7-9e5f5f968afa None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.257212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:40.287768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.288939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.289415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.289880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.348640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22eb4d-8f7d-48b8-87c0-0b37ec4a40d1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.371375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.373437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.408143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.408740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.409016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.409285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] PATH_INFO: `/v3/users/12a8a9ef0d924044a524aa31f3a81752` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.410450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] RBAC: Authorizing `identity:get_user(user_id=12a8a9ef0d924044a524aa31f3a81752)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.411938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.414177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 81/167] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:40 2022] GET /identity/v3/users/12a8a9ef0d924044a524aa31f3a81752 => generated 289 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:40.419098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.491584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 87/168] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:40.492271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:40.501867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.609493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2548b5-4825-4fc5-810c-93c794837a93 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.658826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.659515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.659782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.660053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.661288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.662751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.664746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 82/169] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:40 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:40.671289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.686442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:40.717624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f717b91-b486-41ff-b339-1f1802b592c7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.774570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.775248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.775532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.775805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.780020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.781616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a520-c30d-43ce-af85-85eb3ffe0391 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.783443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 88/170] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:40 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:40.784734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502803a-efdd-41a6-983f-e24bd3a29c70 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.785032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502803a-efdd-41a6-983f-e24bd3a29c70 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.785282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502803a-efdd-41a6-983f-e24bd3a29c70 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.786665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 89/171] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:40.801627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.801880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.802202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.802941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda6c19-3fb1-4e28-92f2-3704a92ba0db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:40.834013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:40.835361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:40.839267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:40.839966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:40.840241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:40.840513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/12a8a9ef0d924044a524aa31f3a81752/roles/5c4b9f176b4e438490261fa3b2ee4825` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:40.842526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, user_id=12a8a9ef0d924044a524aa31f3a81752, role_id=5c4b9f176b4e438490261fa3b2ee4825)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:40.844030 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:40.865871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 83/172] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:40 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/users/12a8a9ef0d924044a524aa31f3a81752/roles/5c4b9f176b4e438490261fa3b2ee4825 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:19:40.872266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:40.903093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:40.947963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 90/173] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:41.002646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:41.031300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:41.115800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dd223-ff46-4ca2-b57a-efd145256bc0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:41.199720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcd8e-87e5-4f6e-ba49-2cf43edfe87b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:41.255217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:41.255878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:41.256154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:41.256435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:41.257348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:41.257742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:41.259366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:41.259495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:41.260265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:41.260710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:41.261118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:41.281495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 84/174] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:40 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=070fb9808a24437b8676aa149373541e => generated 608 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:41.281789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:41.287055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:41.288145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:41.289031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:41.296822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 91/175] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:41.308424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:41.490092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21f7c6-e549-40e1-b027-bd9ec664a8b0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:41.526122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:41.536696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:41.537275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:41.537572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:41.537825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:41.538498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:41.538789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:41.540196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:41.549295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 85/176] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:41.555920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:41.648086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:41.748553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b9424-92ba-4934-a0e4-ae5368637cc8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:41.806838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:41.807608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:41.807888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:41.808161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] PATH_INFO: `/v3/users/2299e2d24b15412c94b8944dc0ab1c99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:41.811999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] RBAC: Authorizing `identity:get_user(user_id=2299e2d24b15412c94b8944dc0ab1c99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:41.813499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d4cc3-5f46-4f04-8ade-a9e7d273b8ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:41.815218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 92/177] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:41 2022] GET /identity/v3/users/2299e2d24b15412c94b8944dc0ab1c99 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:41.821575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:41.976437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a6d-7120-47c0-aae5-35fab85ae80b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.033110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.033781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.034070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.034291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.089417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749acdf-cd07-4025-a04a-10bd8f8f1f8a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.089747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749acdf-cd07-4025-a04a-10bd8f8f1f8a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.089936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749acdf-cd07-4025-a04a-10bd8f8f1f8a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.093713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 93/178] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:42.109635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.110267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.110778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.133480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.144980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.146877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6e98-151a-40d7-a2c7-7ade94a856cf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.147601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:42.149333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:42.247516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 94/179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:42.272832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.313013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.349762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 86/180] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:42.351181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c5e0-f6ae-45f4-b838-263e355b7cb7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.351494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c5e0-f6ae-45f4-b838-263e355b7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.351772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c5e0-f6ae-45f4-b838-263e355b7cb7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.358169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 87/181] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:42.358649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315c5e0-f6ae-45f4-b838-263e355b7cb7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.389068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050f38d-9b88-43c6-b7ae-24c1ee513024 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.427307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.428842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.429535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.430133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.443644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ab9488d4-062b-4232-9ca0-9de482311331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:42.448749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:42.449631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:42.450415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:42.452916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 95/182] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:42.454367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.454859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.455388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.474553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:42.476159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:42.478663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315c5e0-f6ae-45f4-b838-263e355b7cb7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.495720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.516383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.517045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.517324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.517592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] PATH_INFO: `/v3/projects/7e473477202a42d2b42512f270385656` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.518732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] RBAC: Authorizing `identity:get_project(project_id=7e473477202a42d2b42512f270385656)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.520329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.522137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 88/183] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/projects/7e473477202a42d2b42512f270385656 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:42.527935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.551081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 96/184] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:42.552298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.577544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.661768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517412a-ce05-4fe8-b9f2-38d3cb84ecfc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.669017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1078-fc5c-40e4-a17e-0dcfee898739 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.696940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.697573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.697849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.698120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.698857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=7e473477202a42d2b42512f270385656, user.id=2299e2d24b15412c94b8944dc0ab1c99) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:42.699163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.700652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.705871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.706537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.707004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 97/185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/role_assignments?user.id=2299e2d24b15412c94b8944dc0ab1c99&scope.project.id=7e473477202a42d2b42512f270385656&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:42.707112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.707677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.715726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.716873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:42.718402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.720846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f192-bc9f-4972-95de-06ce0e3cd5ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.735144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 89/186] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:42.737559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e927b6-c8e6-485a-b112-48a960476ddd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.738267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e927b6-c8e6-485a-b112-48a960476ddd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.739266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e927b6-c8e6-485a-b112-48a960476ddd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.741480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 90/187] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:42.744427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e927b6-c8e6-485a-b112-48a960476ddd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.777833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.810921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:42.830155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304672f0-0361-48d6-b813-e9ba115fc3ac None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.869396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.870071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.870341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.870607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.871836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.874145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9eb3b-d7f0-46ce-8333-2d6d8348c013 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.875946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e927b6-c8e6-485a-b112-48a960476ddd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:42.876157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 98/188] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:42.877417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.877705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.878323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.902509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:42.903768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:42.924106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:42.924714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:42.924996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:42.925270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:42.943244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:42.945141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:42.946922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 91/189] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:42.947743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:42.998931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 99/190] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:43.003373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.043688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.064127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b860217-90ed-4e51-b2cc-da16a964fea6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.089799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.102701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.103368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.103666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.103911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.104573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.106029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.110489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686045ee-9c1a-41bc-8026-705966f7fddd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.131046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 92/191] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:42 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:43.132768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.147016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.147696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.147974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.148299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.225746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.227234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.278356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041337e-be54-4702-bd1c-b47b22b307c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.318450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.319522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.320062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.320567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.321984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.324406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.337407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:43.343007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 100/192] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:43.343479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:43.344316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:43.345315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 93/193] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:43.351565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.351914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.508758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd7c5-b411-4909-8a00-6c572406e419 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.512158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f832a43-a848-4430-a945-09bcfab9063c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.549593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.550264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.550747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.550852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.552002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.553478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f079-8904-4c50-8d17-d5dc9bc5d986 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.555351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 94/194] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:43.556864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.557503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.557776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.558042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.558723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:43.559022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.560506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3405c-ba76-4938-a38a-864ed6e7e4a4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.560645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8aa92-4c9c-4227-a240-3c76ba45d17b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.561111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8aa92-4c9c-4227-a240-3c76ba45d17b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.561388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8aa92-4c9c-4227-a240-3c76ba45d17b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.563076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 95/195] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:43.564102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8aa92-4c9c-4227-a240-3c76ba45d17b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.574039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 101/196] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:43.575478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.575822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.576176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.599090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:43.600334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:43.644080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.664281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:43.680512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 102/197] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:43.682273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.727278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8aa92-4c9c-4227-a240-3c76ba45d17b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.774007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.775521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.775994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.776434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.777832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=dba9b806a7e549448e7a5f33d7e7fba4) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:43.778773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.780931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.788740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 96/198] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/role_assignments?user.id=dba9b806a7e549448e7a5f33d7e7fba4&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:43.790482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.813312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2a4dd-6286-49a4-a495-850689f0ba3d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.880825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:43.881514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:43.881793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:43.882067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:43.884235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:43.886687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:43.895249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 103/199] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:43.904712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:43.995390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b81af-84ca-4d0e-8dac-b6f0660803e0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:43.997333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.063663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.075326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.075976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.076249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.076577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.098586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:44.111899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:44.113038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:44.114007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:44.114740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 97/200] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:44.116940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99fa0f-5d5e-4fd9-9b6d-66a526ee319b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:44.121235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.170673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.172213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.172499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.172773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.273136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eccf12-332c-43a1-9669-bc85de2c2502 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:44.316426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.317439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.317932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.318393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.319317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:44.319817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:44.321572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:44.332182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 98/201] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:44.338399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.359903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:44.361692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:44.397360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.456436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa831cd-d413-4f8e-91e7-aa6529ba4450 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:44.482379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.494712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.495774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.496275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.496753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] PATH_INFO: `/v3/users/12a8a9ef0d924044a524aa31f3a81752` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.498144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] RBAC: Authorizing `identity:get_user(user_id=12a8a9ef0d924044a524aa31f3a81752)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:44.499911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:44.501786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 99/202] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/users/12a8a9ef0d924044a524aa31f3a81752 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:44.507602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.617807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692511df-3f62-4236-bc83-a613a0921b79 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:44.635749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 104/203] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:44.637342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.643443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.658091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.659127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.659641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.660110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.735582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:44.737456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:44.836794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c4740-0cec-49c2-a451-2191a24d57d7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:44.861815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 100/204] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:44.867898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.887182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.891923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:44.892641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:44.892877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:44.893151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:44.900108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:44.901613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:44.903571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 105/205] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:44.909377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:44.959764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:44.976841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f94d5-97e7-402b-8fd9-71bb10b7b5ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:45.020872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:45.022444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.023091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.023790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.026007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:45.029010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:45.032057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb95dc8-c2e4-4c7e-a658-d21ba7837e3c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:45.032223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 101/206] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:45.039659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:45.072075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:45.073004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.073452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.073865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.074756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=dba9b806a7e549448e7a5f33d7e7fba4) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:45.075230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:45.077143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282c0d7-cd21-4cc5-ae16-08c433726fcd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:45.083504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 106/207] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:44 2022] GET /identity/v3/role_assignments?user.id=dba9b806a7e549448e7a5f33d7e7fba4&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=070fb9808a24437b8676aa149373541e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:45.149705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:45.167724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297818-2dab-49e2-a3b3-59d4feec5d31 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:45.217487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:45.218135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.218408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.218677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.219475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, scope.project.id=31c351c18ffe44b597a9942e3cddb285, user.id=12a8a9ef0d924044a524aa31f3a81752) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:45.219784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:45.221386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc087-7d21-4294-8637-49037119b6f6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:45.228536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 102/208] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:45 2022] GET /identity/v3/role_assignments?user.id=12a8a9ef0d924044a524aa31f3a81752&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:45.766209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8161-f44c-4573-b4ad-d030567c8bb3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.766870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8161-f44c-4573-b4ad-d030567c8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.767342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8161-f44c-4573-b4ad-d030567c8bb3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.769250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 107/209] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:45.774528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.774803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.775075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.778625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e40b9-caa1-4017-9ea9-f8a040aa7187 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.778920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e40b9-caa1-4017-9ea9-f8a040aa7187 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.779178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e40b9-caa1-4017-9ea9-f8a040aa7187 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.780733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 108/210] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:19:45.788672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:45.788978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:45.789220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:45.799131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:45.800448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:45.812750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:45.814585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:45.888936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 103/211] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:45.901904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 109/212] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:45.913779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:45.925177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:45.928632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.020897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.046907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f92b4-f60f-4bb4-8b48-463580480af5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.047433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40468eb9-d67f-4af1-8441-788c760c7221 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.093601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.094262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.094702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.095113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.096459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.096590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.097135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.097553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.097953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.098230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.102190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 104/213] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:46.108356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.113979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:46.118988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:46.119928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:46.120726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:46.127331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 110/214] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:46.129160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.208599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.251688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce64ae-ac89-46d2-8c77-6926e1ef5344 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.252849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ee576-6ecd-4da5-8b6d-ac0b85b37bc9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.291752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.292258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.292538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.292805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.293519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.295058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb29c88-e86c-428c-b341-049094c88d90 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.300163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.300918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.301192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.301456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.303045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:46.303045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.303828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3e5d-5fe7-446d-9a5c-a9c4aa9ed44d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.319247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 111/215] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:46.319247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc9a61-341f-40c3-9be7-442efffa5000 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.319247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc9a61-341f-40c3-9be7-442efffa5000 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.319247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc9a61-341f-40c3-9be7-442efffa5000 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.320214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 112/216] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:46.321848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc9a61-341f-40c3-9be7-442efffa5000 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.328159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 105/217] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:46 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:46.330076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.330556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.331066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.339740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.353596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:46.357251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:46.473290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 106/218] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:46.485435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc9a61-341f-40c3-9be7-442efffa5000 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.496488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.515589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.524764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.525417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.525700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.525970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] PATH_INFO: `/v3/users/04c3ae6aea174c2f936dee1cecc15815` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.541967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] RBAC: Authorizing `identity:get_user(user_id=04c3ae6aea174c2f936dee1cecc15815)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.543386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.545439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 113/219] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/users/04c3ae6aea174c2f936dee1cecc15815 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:46.555470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.623811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82672b-8445-4dec-a230-b0437c7e5ba8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.666032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.666618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.666893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.667162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.670846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.682873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:46.688214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:46.689127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:46.689918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 107/220] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:46.690561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1ced-6e34-4d24-b2cb-7f0160f7b298 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.696068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.729214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.730909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.731526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.731791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.794108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:46.815165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.817467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.837789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847fd22-7e01-4cf2-98b5-46e4ce8d8d29 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:46.884737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:46.885793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:46.886084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:46.886354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:46.887268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:46.889493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:46.890430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:46.899655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 108/221] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:46.906271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.940007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 114/222] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:46.952428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:46.978786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:47.029402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509a4f0-9b7a-4a30-a0cd-c6d450afc7e7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.067481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.068471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.068947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.069411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.070899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:47.072729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:47.074979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 109/223] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:47.080909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:47.136882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:47.173043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e948fc5-9a49-456e-9c08-ff3e3dfff9e8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.195534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be99f-725d-4256-b1de-af571e651dcd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.221182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:47.243220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.244307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.244586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.244857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.246864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.247551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.247869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.248141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.249288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:47.250772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:47.251885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:47.253393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:47.255303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 115/224] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:46 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:47.256882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 110/225] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:47 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:47.266587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:47.267269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:47.371000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699ace-4d74-454f-8cfb-9486fbdbaea1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.405911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.406935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.407430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.407912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.408868 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=04c3ae6aea174c2f936dee1cecc15815) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:47.409383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:47.411065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ef1c7-2602-4040-a49d-5f8868517b97 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:47.417254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 111/226] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:47 2022] GET /identity/v3/role_assignments?user.id=04c3ae6aea174c2f936dee1cecc15815&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:47.473699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eae4e-c647-4691-895a-fd2b582cdbd6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.533103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.534215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.534687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.535147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/dba9b806a7e549448e7a5f33d7e7fba4/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.537397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, user_id=dba9b806a7e549448e7a5f33d7e7fba4, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:47.539125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34098c-62db-4d28-bae6-59e1653d352f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:47.569368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 116/227] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:47 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/dba9b806a7e549448e7a5f33d7e7fba4/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:47.619214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2942d-6cf3-429b-912f-00c998e63f98 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.619702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2942d-6cf3-429b-912f-00c998e63f98 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.620074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2942d-6cf3-429b-912f-00c998e63f98 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.621651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 112/228] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:47.627879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.628159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.628435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.654258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:47.655714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:47.667014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:47.756050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 117/229] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:47.777810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2942d-6cf3-429b-912f-00c998e63f98 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:47.846267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:47.896629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2942d-6cf3-429b-912f-00c998e63f98 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:47.935084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:47.935802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:47.936110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:47.936383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:47.952670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:47.958222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:47.959182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:47.960021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 113/230] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:47.968431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:48.099954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8127a-c660-4492-bad5-a463ea9aadd0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:48.135931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:48.136561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:48.136832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:48.137104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:48.137788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:48.138086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:48.139643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:48.148560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 118/231] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:48.155243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:48.271856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a018-d1de-4d27-b586-c15e508a2f5c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:48.292450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:48.313970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:48.314624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:48.314901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:48.315173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:48.316708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:48.318187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:48.324239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 114/232] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:48 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:48.330147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:48.338854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:48.453383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0b5d0-9d07-4465-8a80-066ff7ce2cdf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:48.489731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:48.490445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:48.490771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:48.491043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:48.492352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:48.493814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8adaf-4eda-4d2e-951d-54c17a183304 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:48.496294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 119/233] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:48 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:48.504425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:48.653806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de744209-adaf-4d2b-aa13-d3f1801a5e61 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:48.705437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:48.706049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:48.706325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:48.706595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/dba9b806a7e549448e7a5f33d7e7fba4/roles/070fb9808a24437b8676aa149373541e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:48.708869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, user_id=dba9b806a7e549448e7a5f33d7e7fba4, role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:48.710424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614adda-8871-445f-82f5-49d301a0ae6e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:48.730704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 115/234] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:48 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/dba9b806a7e549448e7a5f33d7e7fba4/roles/070fb9808a24437b8676aa149373541e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:48.993982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0af56-a6d8-49ed-8513-71120e34cb10 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:48.994496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0af56-a6d8-49ed-8513-71120e34cb10 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:48.994496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0af56-a6d8-49ed-8513-71120e34cb10 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:48.996216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 120/235] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:49.002671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef408f-6268-48a3-b035-61d700f26710 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.002998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef408f-6268-48a3-b035-61d700f26710 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.003262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef408f-6268-48a3-b035-61d700f26710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.024473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7ef408f-6268-48a3-b035-61d700f26710 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:49.026254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7ef408f-6268-48a3-b035-61d700f26710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:49.083366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:49.113994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 116/236] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:49.136375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0af56-a6d8-49ed-8513-71120e34cb10 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.219549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:49.251977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0af56-a6d8-49ed-8513-71120e34cb10 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:49.263431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d325d4-0397-4bd7-97ee-0f1258ae99e6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.263756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d325d4-0397-4bd7-97ee-0f1258ae99e6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.264046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d325d4-0397-4bd7-97ee-0f1258ae99e6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.265597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 117/237] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:19:49.280705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.281352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.281352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.287979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:49.288632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.288906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.289175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.300651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:49.306601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:49.307534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:49.309269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 121/238] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:49.314115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.332357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:49.333566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:49.448694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 118/239] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:49.452920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947803d2-9651-4865-990b-ad8a4345c0fc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:49.484231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:49.489536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:49.490383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.490661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.490914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.491017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.491679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:49.492056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:49.493615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:49.504157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 122/240] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:49.510139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.621239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8caa5-79bd-4543-bc8a-5d20cfb320a9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:49.685468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:49.687927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a38334-910f-4472-886f-4a06ad4303d3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:49.689992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.690267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.690536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] PATH_INFO: `/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.694881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:49.728022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] RBAC: Authorizing `identity:get_user(user_id=f03830502d6a43ea9fbbbdcd5e2212a2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:49.729845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:49.732209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 123/241] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:49 2022] GET /identity/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:49.747594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.756167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:49.756751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:49.757023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:49.757319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:49.764556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:49.766084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:49.767804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 119/242] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:49.773537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:49.867700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:49.947169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9045-bf07-4baa-9a67-c3653f888e7e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:49.978901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162a9e5-14b4-440a-9766-5444b38fca77 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.001194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.001842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.002122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.002396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.003062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:50.007317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd6c7-d5c7-4155-966e-bc467ca10e86 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:50.036724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.037343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.037623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.037870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.043276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 120/243] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:49 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:50.043276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b8d3-27bb-447b-9cfa-723a9a593b98 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.043276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b8d3-27bb-447b-9cfa-723a9a593b98 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.043276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b8d3-27bb-447b-9cfa-723a9a593b98 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.049519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 121/244] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:50.051139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4026-cb1c-44be-aa25-4560c81f87c8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.051458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4026-cb1c-44be-aa25-4560c81f87c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.052304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f4026-cb1c-44be-aa25-4560c81f87c8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.054208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 122/245] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:50.056469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f060e3-38c1-4f71-a6dd-703858cd7431 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.056813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f060e3-38c1-4f71-a6dd-703858cd7431 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.057261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f060e3-38c1-4f71-a6dd-703858cd7431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.082516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-53f060e3-38c1-4f71-a6dd-703858cd7431 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:50.085004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-53f060e3-38c1-4f71-a6dd-703858cd7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:50.119043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.129905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:50.131486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:50.196406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 123/246] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:50.204504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.205709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996532e-7ae4-4537-954a-038870fa11df None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.206044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996532e-7ae4-4537-954a-038870fa11df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.206375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996532e-7ae4-4537-954a-038870fa11df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.238643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2996532e-7ae4-4537-954a-038870fa11df None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:50.239891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2996532e-7ae4-4537-954a-038870fa11df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:50.282584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 124/247] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:19:50.284150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.341895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 124/248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:50.342678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996532e-7ae4-4537-954a-038870fa11df None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.437319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759d499-d216-48be-a705-2bea9b68cf98 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.484779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.487626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.488652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.488951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.489286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.500499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996532e-7ae4-4537-954a-038870fa11df None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.502033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:50.506931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:50.508111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 125/249] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:50.508952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.527396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.550166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.550757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.551051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.551353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.552508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:50.554972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:50.556874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 125/250] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:50.557695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.644010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ef1b-f91a-4324-b015-c797e4d2fa7f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.714430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.715855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.716135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.716407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.720879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627b916-0ea4-4fa8-a9d8-23148fac6237 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.742356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:50.748703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:50.749654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:50.750435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 126/251] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:50.751070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.798985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:50.800024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:50.800499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:50.800905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:50.801751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:50.802220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:50.803809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:50.815029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:50.816638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:50.847181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.920877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:50.950666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22aa8a-c06f-4780-bfac-c9c1be7d626e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:50.966372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d802fd-131c-4702-9bc6-6d28985f8d81 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.004020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.004668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.004939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.005208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.005912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:51.006211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.007667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.025590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 127/253] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:51.026500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.036290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.036925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.037488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.037488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.038184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=f03830502d6a43ea9fbbbdcd5e2212a2) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:51.038485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.040020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.055562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 127/254] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:50 2022] GET /identity/v3/role_assignments?user.id=f03830502d6a43ea9fbbbdcd5e2212a2&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:51.056374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.192750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7df36-a46d-42c9-bf45-10fa7538410a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.251966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:51.284141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.284831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.285165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.285363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] PATH_INFO: `/v3/users/04c3ae6aea174c2f936dee1cecc15815` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.286678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] RBAC: Authorizing `identity:get_user(user_id=04c3ae6aea174c2f936dee1cecc15815)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.288341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.290495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:51 2022] GET /identity/v3/users/04c3ae6aea174c2f936dee1cecc15815 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:51.303137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb594d-7887-4bc2-aea9-7438b7c92fa4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.307776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.314348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:51.374007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.374706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.374947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.375236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.376603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.378081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.379759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:51 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:51.388179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.529125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495ace-97e9-4640-9cf7-0ba161b67463 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.579437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.580009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.580453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.580860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.582218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.584162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1f19b-06ad-4f96-adb2-87999af0c68d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.586495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:51 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:51.587990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a635-e999-41c4-9f3f-84cfff790270 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.588269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a635-e999-41c4-9f3f-84cfff790270 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.588541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a635-e999-41c4-9f3f-84cfff790270 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.595458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 130/258] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:51.596312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a635-e999-41c4-9f3f-84cfff790270 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.608678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4e49-ef20-46b6-a1ef-f1ab020c250b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.678658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:51.689099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.689939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.690308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.690679 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.714261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a635-e999-41c4-9f3f-84cfff790270 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:51.729538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:51.760631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:51.761462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.761741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.762014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/04c3ae6aea174c2f936dee1cecc15815/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.764249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, user_id=04c3ae6aea174c2f936dee1cecc15815, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.765732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef5d7-a60e-49d8-8caa-a897b921cbe1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.803646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 131/259] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:51 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/04c3ae6aea174c2f936dee1cecc15815/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:51.804650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:51.804937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:51.805212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:51.809962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:51.811740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:51.852512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:51.853622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:51.940729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 129/260] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:51.947609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:51.979850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 132/261] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:52.022715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:52.053250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:52.149991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f42-21a5-4976-a174-a51312a905a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.155550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:52.207009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2db6f4-7021-4156-b32b-36c42501ec64 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.235864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.236876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.237355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.237822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:52.240020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:52.241681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:52.245040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 130/262] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:51 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:52.251091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:52.281052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.283552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.284034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.284492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:52.307646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:52.312666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:52.313536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:52.314333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 133/263] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:19:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:52.337502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:52.392173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf9f8-b7c5-4711-a0de-6990b631613f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.414120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:52.439232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.442962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.443287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.443564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:52.445690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=dba9b806a7e549448e7a5f33d7e7fba4) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:52.446004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:52.447517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:52.463950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 131/264] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:52 2022] GET /identity/v3/role_assignments?user.id=dba9b806a7e549448e7a5f33d7e7fba4&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:52.537804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782c7d-afd2-47a5-9606-24c46502cf25 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.587937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:52.592176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.592852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.593131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.593492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:52.594304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:52.594884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:52.597928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:52.608969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 134/265] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:19:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:52.615449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:52.737755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9108e-408c-4e13-9354-5035d585a8af None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.776655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.777610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.778029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.778466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] PATH_INFO: `/v3/users/dba9b806a7e549448e7a5f33d7e7fba4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:52.779845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] RBAC: Authorizing `identity:get_user(user_id=dba9b806a7e549448e7a5f33d7e7fba4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:52.781438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b11a8e-ee13-4497-9599-813d670f05dd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:52.783222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 132/266] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:52 2022] GET /identity/v3/users/dba9b806a7e549448e7a5f33d7e7fba4 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:52.789503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:52.907107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c5897-4310-4d07-a56d-c0806d7bc645 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:52.954391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:52.955033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:52.955342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:52.955618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.032278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.067463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:53.070300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:53.175620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8af70-eaf0-4f10-be7d-eb3e9748eefb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.176261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8af70-eaf0-4f10-be7d-eb3e9748eefb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.176734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8af70-eaf0-4f10-be7d-eb3e9748eefb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.182930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 133/267] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:53.184902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6faea6-ad8d-46b9-917e-633c26884131 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.185405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6faea6-ad8d-46b9-917e-633c26884131 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.186039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6faea6-ad8d-46b9-917e-633c26884131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.211026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 135/268] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:53.216757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.229444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fe6faea6-ad8d-46b9-917e-633c26884131 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:53.230756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe6faea6-ad8d-46b9-917e-633c26884131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:53.306437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.317992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.335531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d7803-0647-413f-b9a8-1ceaeae3c545 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.337982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:53.339722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ffa-901d-49a5-9445-604a702e8c92 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.340222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ffa-901d-49a5-9445-604a702e8c92 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.340692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ffa-901d-49a5-9445-604a702e8c92 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.346499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 135/270] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:53.348737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.349227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.349695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.383755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:53.384990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:53.402717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:53.403783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.404306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.404854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.406387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:53.408237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:53.415307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 136/271] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:53 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:53.416543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.473722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 136/272] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:53.480431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.535779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0eee0-2545-4da0-b612-e00a6d6aca50 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.574407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:53.575719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.577188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.577682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.579078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:53.580788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:53.583619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 137/273] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:53.584648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.611445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d244f2a-5e44-452d-9ef2-b49b2ff24e3b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.615241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.623102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.651548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:53.652182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.652457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.652727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.653669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=dba9b806a7e549448e7a5f33d7e7fba4) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:53.653966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:53.655485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:53.663879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 137/274] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:53 2022] GET /identity/v3/role_assignments?user.id=dba9b806a7e549448e7a5f33d7e7fba4&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=070fb9808a24437b8676aa149373541e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:53.663879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.728788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387da34-0e51-4ba2-a7fc-4cb1f655fc96 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.770473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:53.771785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.771785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.772006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.784767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2f7002fe-364f-439b-8aee-ba98056a28d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:53.790414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:53.791580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:53.792564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:53.796730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 138/275] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:53.798315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a047-34b1-40e7-893f-2c48433291b4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.798646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a047-34b1-40e7-893f-2c48433291b4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.799053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a047-34b1-40e7-893f-2c48433291b4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.800854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 139/276] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:53.805892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344a047-34b1-40e7-893f-2c48433291b4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:53.814163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c6228-35f6-4644-990f-2829b1dd2f97 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.865569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:53.866955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.867426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.867844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.868703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:53.871159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd5d63-b99c-43d5-a280-38c4abb0b0c7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:53.902639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 138/277] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:19:53 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:53.905066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:53.905625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:53.906132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:53.912027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:53.943669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:53.945291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:53.952260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344a047-34b1-40e7-893f-2c48433291b4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:53.978871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.001346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.001958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.002239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.002513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.003475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:54.003805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.005249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.016807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 140/278] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:54.023868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.045826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 139/279] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:54.068654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.145620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda492-2e65-41b7-90af-40ff7cd01127 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.182350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.183026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.184605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.184605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] PATH_INFO: `/v3/users/39c9cae00ca548f3a51c04379777dd65` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.184796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df62d6d-ae23-4fa8-accb-65b726539142 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.199916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.203550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] RBAC: Authorizing `identity:get_user(user_id=39c9cae00ca548f3a51c04379777dd65)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.205663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.211703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 141/280] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/users/39c9cae00ca548f3a51c04379777dd65 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:54.213952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.236125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.237128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.237609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.238034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.250413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:54.255428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:54.256311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:54.257098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 140/281] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:54.265263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.294468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.362354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98998a-808e-4c7b-8285-245dbf3080f4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.411593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.412147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.412425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.412691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.412940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0061-3f57-4c74-9b40-e5cc8094971d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.413566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, user.id=39c9cae00ca548f3a51c04379777dd65, scope.system=all) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:54.413879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.415699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.432226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 142/282] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/role_assignments?user.id=39c9cae00ca548f3a51c04379777dd65&scope.system=all&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:54.462906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.464032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.464523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.464979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.465949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:54.466454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.468198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729ee5-5147-4080-ae3d-918ba26cc1e5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.478923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 141/283] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:54.485935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.584582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.638171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53beb5c7-ccad-403e-8898-073c6e84312a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.676623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8976-3ce2-49c3-8ab0-e1869c839fff None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.676968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8976-3ce2-49c3-8ab0-e1869c839fff None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.677167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8976-3ce2-49c3-8ab0-e1869c839fff None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.677263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.678008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.678291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.678668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] PATH_INFO: `/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.678779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 142/284] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:19:54.680097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] RBAC: Authorizing `identity:get_user(user_id=f03830502d6a43ea9fbbbdcd5e2212a2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.681632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.683691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 143/285] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:54.684017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.684346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.684625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.692521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.720139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:54.721317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:54.846716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:54.862231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3660b98-f172-4b8f-83cb-4701199b4259 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:54.893708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:54.905580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.928666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:54.932802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:54.933936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:54.935119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:54.935822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:54.938599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:54.940878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:54.944033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:54.948815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:55.029661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee214a-4b53-41bd-ba69-2b9f15408bf3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:55.090627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:55.091313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:55.091606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:55.091890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:55.115305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:55.120730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:55.121661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:55.122440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:55.124182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 144/288] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:55.134511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:55.165652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30794-4272-46ec-9796-d898d4ca5634 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:55.238499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:55.239774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:55.240270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:55.240706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/f03830502d6a43ea9fbbbdcd5e2212a2/roles/5c4b9f176b4e438490261fa3b2ee4825` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:55.247706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, user_id=f03830502d6a43ea9fbbbdcd5e2212a2, role_id=5c4b9f176b4e438490261fa3b2ee4825)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:55.251495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:55.286316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 145/289] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:19:54 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/users/f03830502d6a43ea9fbbbdcd5e2212a2/roles/5c4b9f176b4e438490261fa3b2ee4825 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:19:55.292486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:55.354895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643a4dc-afc0-4948-884d-538189acf166 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:55.406105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:55.406745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:55.407022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:55.407324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:55.408018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:55.408380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:55.409877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:55.421025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 145/290] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:55.427179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:55.515379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:55.565188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dffd36-1781-4bf4-a6ff-04a6b4a7b767 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:55.609300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:55.610345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:55.610829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:55.611319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] PATH_INFO: `/v3/users/04c3ae6aea174c2f936dee1cecc15815` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:55.615962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] RBAC: Authorizing `identity:get_user(user_id=04c3ae6aea174c2f936dee1cecc15815)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:55.617700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:55.619634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 146/291] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:55 2022] GET /identity/v3/users/04c3ae6aea174c2f936dee1cecc15815 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:55.626236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:55.763522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43a9cf-e4b1-4876-b1b5-1dba5e4640e4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:55.807728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:55.813958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:55.814754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:55.815303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:55.815774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:55.906130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:55.907633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:56.014890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:56.020930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:56.167957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20855ac-8e14-41d8-b823-371b37511950 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:56.207601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:56.221220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:56.222226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.222715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.223177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.224528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:56.226166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317aca8-24fa-4a3b-8bc6-bdab981ada42 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:56.228046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 147/293] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:56 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:56.234190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:56.266028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:56.337242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc06c-7760-4051-ac5e-d55f680bca2a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:56.372579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:56.373643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.374132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.374619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.375572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=04c3ae6aea174c2f936dee1cecc15815) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:56.376069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:56.377695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d9e06-8981-479f-b4ba-8c2bb584a087 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:56.384466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 147/294] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:56 2022] GET /identity/v3/role_assignments?user.id=04c3ae6aea174c2f936dee1cecc15815&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:56.588695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba774ac-220f-43ef-b293-0b00ad1bcde3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.589719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba774ac-220f-43ef-b293-0b00ad1bcde3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.590189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba774ac-220f-43ef-b293-0b00ad1bcde3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.592102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 148/295] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:56.598182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891208-4fa0-40ff-b67d-5566f96ccf2d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.598778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891208-4fa0-40ff-b67d-5566f96ccf2d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.599270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891208-4fa0-40ff-b67d-5566f96ccf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.618826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d4891208-4fa0-40ff-b67d-5566f96ccf2d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:56.620398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d4891208-4fa0-40ff-b67d-5566f96ccf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:56.691577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:56.715836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba774ac-220f-43ef-b293-0b00ad1bcde3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:56.838867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba774ac-220f-43ef-b293-0b00ad1bcde3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:56.880349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10e3c-986b-4656-860e-4d5e3fd02ec3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.880667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:56.881140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10e3c-986b-4656-860e-4d5e3fd02ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.881331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.881427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10e3c-986b-4656-860e-4d5e3fd02ec3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.881590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.881884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.882751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 149/297] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:56.889264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:56.889899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:56.890385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:56.899240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:56.904277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:56.905355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:56.906437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 149/298] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:56.912335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:56.921632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:56.923921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:56.959659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:56.981167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.033300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 150/299] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:57.043187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cc603-5470-4416-8615-f24c1eefc316 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.057284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.086355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.086987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.087293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.087564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.088531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:57.088836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.091427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.103413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 150/300] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:57.112267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.182639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6612cc-e02e-40d4-b11c-566e50a4f6cd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.220958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.221525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.221794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.222064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.223182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.224669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09746366-3c1c-4a53-9760-09849242f730 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.226547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 151/301] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:57.227682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6925e-d808-40ca-bfdb-31d7a532436e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.227966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6925e-d808-40ca-bfdb-31d7a532436e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.228231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6925e-d808-40ca-bfdb-31d7a532436e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.229480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 152/302] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:57.236427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6925e-d808-40ca-bfdb-31d7a532436e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.248084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc148c3-9a9d-44f3-9e06-a3042cd8dfe2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.265075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.270340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.289325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.290074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.290350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.290606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] PATH_INFO: `/v3/users/641b59f83498497d8e4bc391007d036c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.305939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] RBAC: Authorizing `identity:get_user(user_id=641b59f83498497d8e4bc391007d036c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.307943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b394741-0537-4525-909d-a2f7a78c101e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.309879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 151/303] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/users/641b59f83498497d8e4bc391007d036c => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:57.311016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518275-77e6-4795-b914-957927010069 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.311318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518275-77e6-4795-b914-957927010069 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.311593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518275-77e6-4795-b914-957927010069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.330445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1a518275-77e6-4795-b914-957927010069 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:57.331704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a518275-77e6-4795-b914-957927010069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:57.365291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6925e-d808-40ca-bfdb-31d7a532436e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.404683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.405547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 152/304] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:57.405790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.406243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.406419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a518275-77e6-4795-b914-957927010069 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.406820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] PATH_INFO: `/v3/groups` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.407645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.409261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.443228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 153/305] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Aug 7 19:19:57 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:19:57.443228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.536392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a518275-77e6-4795-b914-957927010069 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.546008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.563907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.585294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.586100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.586472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.586841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.587111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6a9f-f324-410e-91dd-332b19b65ca4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.587844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, user.id=641b59f83498497d8e4bc391007d036c, scope.system=all) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:57.588251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.590000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.603231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 153/306] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/role_assignments?user.id=641b59f83498497d8e4bc391007d036c&scope.system=all&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:57.638105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.638810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.639085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.639387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.652385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fa65d646-b5d2-48bb-8861-0d3c24d8aad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:57.658101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:57.659073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:57.659941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 154/307] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:57.666283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.786678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a525-4046-4c76-a2a2-ef702132356d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.822996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:57.823657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.823931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.824196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.824498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12d65-21d1-478f-9921-e983d3a44207 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.824931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12d65-21d1-478f-9921-e983d3a44207 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.825025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:57.825100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12d65-21d1-478f-9921-e983d3a44207 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.825177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:57.826425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 155/308] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:19:57.826603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:57.831688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:57.831965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:57.832236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:57.837275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 154/309] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:57.845609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:57.855390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:57.856598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:57.881626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:57.942795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 156/310] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:19:57.963540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b3d2-ee28-40d8-b822-2eab9fa7e17c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:57.966000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.009886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.010585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.011037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.011344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] PATH_INFO: `/v3/users/39c9cae00ca548f3a51c04379777dd65` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.013414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] RBAC: Authorizing `identity:get_user(user_id=39c9cae00ca548f3a51c04379777dd65)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:58.014987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:58.017056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 155/311] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/users/39c9cae00ca548f3a51c04379777dd65 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:58.025675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.078723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:58.114369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1531f42-053a-492c-9d68-d221152996e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:58.140438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:58.144821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75609599-0f97-4bec-97c9-180b4e1022ad None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:58.162129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.162794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.163221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.163626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.178227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:58.184346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:58.184503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:58.186095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:58.187745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:19:58.188500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.188500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.188500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] PATH_INFO: `/v3/system/users/39c9cae00ca548f3a51c04379777dd65/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.195237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 157/312] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:19:58.195397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39c9cae00ca548f3a51c04379777dd65, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:58.195563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.195699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:58.206734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 156/313] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Aug 7 19:19:58 2022] PUT /identity/v3/system/users/39c9cae00ca548f3a51c04379777dd65/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:19:58.326191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5cfe9-3624-4d1b-b527-785cd50cbf60 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:58.374106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.374662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.374985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.375303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.376004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:58.376305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:58.377757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:58.379484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:58.392802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 158/314] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:58.394707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.515584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0b3a-d61a-43b0-8581-80c44d0270f6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:58.551723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.552429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.552703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.553032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] PATH_INFO: `/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.554228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] RBAC: Authorizing `identity:get_user(user_id=f03830502d6a43ea9fbbbdcd5e2212a2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:58.555723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:58.557639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 157/315] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:19:58 2022] GET /identity/v3/users/f03830502d6a43ea9fbbbdcd5e2212a2 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:19:58.563425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.666596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1594c9-235a-4f68-a08b-5cbc837d2426 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:58.701797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:58.702453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:58.702726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:58.702990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:58.773475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:58.780408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:58.782336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:58.885562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 159/316] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:19:58.891315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:58.927473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:59.004373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217c88-938b-4b70-b69a-0ab7720c8da8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:59.040661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:59.041745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.042213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.042679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.044031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:59.045827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0127b-8d09-41c5-825f-6ff64f343db7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:59.048057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 158/317] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:19:58 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:59.053639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:59.152528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:59.158781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a9c34-f678-4f56-b280-ed4ad5d460a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:59.195656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:59.196188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.196462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.196726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.197468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406, user.id=f03830502d6a43ea9fbbbdcd5e2212a2) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:19:59.197767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:59.199222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc4abf-e560-41ed-8e05-819a1b78cdf6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:59.206206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 160/318] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:19:59 2022] GET /identity/v3/role_assignments?user.id=f03830502d6a43ea9fbbbdcd5e2212a2&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:59.666414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa389d-f9f4-443f-890c-af5afb79de4e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.666593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba545-6c3d-4f02-890e-95b98eb7763e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.666692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa389d-f9f4-443f-890c-af5afb79de4e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.666765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba545-6c3d-4f02-890e-95b98eb7763e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.666917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa389d-f9f4-443f-890c-af5afb79de4e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.666989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba545-6c3d-4f02-890e-95b98eb7763e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.668295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 161/320] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:59.668486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 159/320] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:19:59.673434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.673718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.674106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.674211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.674297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.674527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.693098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:59.693317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:19:59.694329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:59.694528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:19:59.767040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 160/321] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:59.769139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 162/322] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:19:59.789118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:59.790554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:59.821474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:59.883698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:19:59.894283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81c98-0936-45c3-ac2d-bca1cc87592c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:59.904288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfa98c-018e-4df2-a36f-697ab9bf03f9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:19:59.929933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:59.930599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.930873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.931147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.932295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:19:59.933760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:19:59.935410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 163/323] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:19:59.941987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:19:59.945080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:19:59.945756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:19:59.946027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:19:59.946291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:19:59.957035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:19:59.961730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:19:59.962642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:19:59.963496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 161/324] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:19:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:19:59.970197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:00.053581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6103de-ee62-4af0-abba-dc97ed890d18 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:00.073608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:00.086061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8d95-d001-426b-bd9e-18330f612365 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:00.089178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:00.089800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.090073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.090337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] PATH_INFO: `/v3/groups` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.090965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:00.092488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:00.109735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 164/325] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Aug 7 19:19:59 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:00.137668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:00.138813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.139337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.139784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.140717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:00.141244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:00.142967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:00.161264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 162/326] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:19:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:00.167820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:00.190558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:00.296657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51186936-ea00-4ff5-910f-0eadc32d62ad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:00.336594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:00.337275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.337518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.337779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] PATH_INFO: `/v3/users/641b59f83498497d8e4bc391007d036c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.338930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] RBAC: Authorizing `identity:get_user(user_id=641b59f83498497d8e4bc391007d036c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:00.340438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b097-55e2-48be-900a-a9b1a653ce4c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:00.342181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 165/327] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:20:00 2022] GET /identity/v3/users/641b59f83498497d8e4bc391007d036c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:00.348143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:00.464310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce341-0719-4d5b-bd5d-ca44427a696c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:00.519324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:00.520859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.521552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.522243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] PATH_INFO: `/v3/system/users/641b59f83498497d8e4bc391007d036c/roles/5c4b9f176b4e438490261fa3b2ee4825` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.524067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c356db-31b3-4e20-8dab-62fad436a5a1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.524511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c356db-31b3-4e20-8dab-62fad436a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.524774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=641b59f83498497d8e4bc391007d036c, role_id=5c4b9f176b4e438490261fa3b2ee4825)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:00.524998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c356db-31b3-4e20-8dab-62fad436a5a1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.527400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 166/328] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:00.527526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:00.533608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.534176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.534646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.542724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 163/329] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Aug 7 19:20:00 2022] PUT /identity/v3/system/users/641b59f83498497d8e4bc391007d036c/roles/5c4b9f176b4e438490261fa3b2ee4825 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:00.557930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:00.559340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:00.646620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 167/330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:00.674119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:00.698107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:00.807247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b107f-e407-458d-87fc-09d970257db9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:00.856189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:00.857287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:00.857790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:00.858317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:00.870540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:00.876322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:00.877211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:00.878003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:00.880841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 164/331] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:00.886520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:00.916241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:01.044726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93027e-bf84-419d-a61c-d8be89c6c598 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:01.112059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:01.112622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:01.112897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:01.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:01.113849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:01.114152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:01.115618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:01.127633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 168/332] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:01.133599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:01.245490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:01.274651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75872-0587-4981-a60d-0fd889394e76 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:01.320351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:01.321364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:01.321837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:01.322314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] PATH_INFO: `/v3/users/39c9cae00ca548f3a51c04379777dd65` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:01.323752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] RBAC: Authorizing `identity:get_user(user_id=39c9cae00ca548f3a51c04379777dd65)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:01.325513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c28f9-aa22-4d67-8805-ba4c34f48464 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:01.327732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 165/333] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:20:01 2022] GET /identity/v3/users/39c9cae00ca548f3a51c04379777dd65 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:01.333259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:01.467739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:01.496197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4742-8a2d-4cdb-a2d5-f80cb7eae9c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:01.539416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:01.540407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:01.540882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:01.541344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:01.542406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] RBAC: Adding query filter params (role.id=a8ae165c6ef74b2d8d474682dc303304, user.id=39c9cae00ca548f3a51c04379777dd65, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:01.542909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:01.544599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1116cd-a1d0-447f-b36b-ec7e6a7f1443 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:01.564562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 169/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 19:20:01 2022] GET /identity/v3/role_assignments?user.id=39c9cae00ca548f3a51c04379777dd65&scope.system=all&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:02.764452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fa77-0d37-4fc5-98bb-81a1fd2b46d1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:02.765016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fa77-0d37-4fc5-98bb-81a1fd2b46d1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:02.765016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41fa77-0d37-4fc5-98bb-81a1fd2b46d1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:02.766333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 166/335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:02.772329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:02.772893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:02.772893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:02.796701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:02.797937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:02.853304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b7b5-1c57-4066-9d62-9ab96b738856 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:02.853644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b7b5-1c57-4066-9d62-9ab96b738856 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:02.853853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39b7b5-1c57-4066-9d62-9ab96b738856 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:02.856522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 167/336] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:02.866597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:02.866913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:02.867142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:02.885812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:02.887132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:02.889228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 170/337] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:02.966076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:02.986015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 168/338] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:03.013091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.095686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.108629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.144209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e01f-17c2-4ac2-8997-ecdc4821e58a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.146684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26ffc1-b403-4215-864e-c3598c542b87 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.200539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.201203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.201573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.203016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.203710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.204014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.204286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.207500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.215630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:03.222410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:03.225135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:03.225995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:03.226793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 171/339] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:03.227467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:03.228295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:03.229087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:03.232597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 169/340] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:03.236546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.238603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.370415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41f8b-02dd-47db-9973-0215301141ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.390747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9347a1-91a7-41f8-ba46-3e6ac1ea2852 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.407577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.409775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.410477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.410683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.410952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.411692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:03.412018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:03.413567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:03.423979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 172/341] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:03.437443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.460573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.461213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.461489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.461754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.462446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:03.462744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:03.464178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998063-0ea4-4cfd-acea-72a9c849cfc8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:03.475600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.478558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 170/342] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:03.480128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eeb8f-3bc6-4ede-80ba-7b86f0c2b9fc None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.480506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eeb8f-3bc6-4ede-80ba-7b86f0c2b9fc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.480844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eeb8f-3bc6-4ede-80ba-7b86f0c2b9fc None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.482469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 171/343] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:03.488361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.488704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.489045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.511652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:03.512969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:03.602045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:03.603470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.615065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3766a4-66f9-489e-8ab9-259a5735f2af None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.667477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.669719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.670228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.670715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:03.757738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:03.760418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:03.779528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.870043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430686e-7dc5-4c65-a0ce-d48ffef30336 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:03.888382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:03.890186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:03.949191 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:03.971331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:03.972626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:03.973098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:03.973679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.001310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.018653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490fcb-201e-43a2-a969-df6985f7ffc7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.062707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.065391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.065564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfef5f-4826-428a-91b0-5d35a6775abc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.066456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.066768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.067109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.079740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:04.085604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:04.086689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:04.087590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 174/346] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:04.088293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.187142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 173/347] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:04.188937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac92-119f-48e4-a0db-6cc590527e80 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.189437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac92-119f-48e4-a0db-6cc590527e80 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.189916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac92-119f-48e4-a0db-6cc590527e80 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.192100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 174/348] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:04.193098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ac92-119f-48e4-a0db-6cc590527e80 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.224625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.236141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e713-4891-4143-8979-e29df1bed1d0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.276855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.277550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.277827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.278099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.279353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.280942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.283069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 175/349] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.284045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.308273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.317079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ac92-119f-48e4-a0db-6cc590527e80 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.356155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.357162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.357711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.358230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.359182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:04.359741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.361456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041e780-1f0f-49a0-b7b8-57e3d66859af None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.371763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 175/350] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.373836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.374410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.374887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.399879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:04.401514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:04.422526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9107f-767e-483d-bfb4-bf7821e59398 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.460920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.461605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.461883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.462151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.463984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.464926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.467103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 176/351] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.472338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.498491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 176/352] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:04.502257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.537360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.575846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.588644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55998e8-43bf-40c0-8604-9abb15c82093 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.625788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.626602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.626974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.627376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.634186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.635826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.638316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 177/353] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.638872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.682135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801ad51-1742-4aeb-acf4-b86e2b40466d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.720567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.720567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.721067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.721436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] PATH_INFO: `/v3/users/641b59f83498497d8e4bc391007d036c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.722783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] RBAC: Authorizing `identity:get_user(user_id=641b59f83498497d8e4bc391007d036c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.724387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.726371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 177/354] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/users/641b59f83498497d8e4bc391007d036c => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.727075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.813437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492e4d-740f-44cc-9915-896abf4e9442 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.831869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.854711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090770-e20a-4b52-9954-3bacd2ff7418 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:04.861229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.866600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.867135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.867733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.869180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:04.870917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:04.872787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 178/355] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:04.873521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:04.901321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:04.902969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:04.903618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:04.903899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:04.904165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:04.918034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:04.923014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:04.924117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 178/356] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:04.925485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.024520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b304e-d107-43a7-89ee-722667365c9e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.070383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df024-e7e2-4fe7-afba-63b418204221 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.072744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.075232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.075596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.075870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.076697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=31c351c18ffe44b597a9942e3cddb285) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:05.077008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:05.078475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e453-7ac1-436e-99b1-925b75a2e03d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:05.086026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 179/357] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:05.087347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f978a7-bfd0-4ef8-b56c-8dbe04b8ad24 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.087632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f978a7-bfd0-4ef8-b56c-8dbe04b8ad24 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.087902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f978a7-bfd0-4ef8-b56c-8dbe04b8ad24 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.089451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 180/358] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:05.090326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f978a7-bfd0-4ef8-b56c-8dbe04b8ad24 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.128346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.129979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.130602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.131255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.132503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] RBAC: Adding query filter params (role.id=5c4b9f176b4e438490261fa3b2ee4825, user.id=641b59f83498497d8e4bc391007d036c, scope.system=all) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:05.133034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:05.136248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:05.155047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 179/359] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Aug 7 19:20:04 2022] GET /identity/v3/role_assignments?user.id=641b59f83498497d8e4bc391007d036c&scope.system=all&role.id=5c4b9f176b4e438490261fa3b2ee4825 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:05.156361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.162626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:05.195045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:05.230985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f978a7-bfd0-4ef8-b56c-8dbe04b8ad24 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.279485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.280167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.281050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.281327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.282386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=070fb9808a24437b8676aa149373541e, scope.project.id=31c351c18ffe44b597a9942e3cddb285) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:05.282694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:05.284410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba666-00f5-4e1e-bc29-21eb27e5dc46 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:05.295459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 181/360] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=070fb9808a24437b8676aa149373541e => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:05.296991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cbe3-6a10-4bbf-84bd-821a06391d31 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.297269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cbe3-6a10-4bbf-84bd-821a06391d31 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.297540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cbe3-6a10-4bbf-84bd-821a06391d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.338044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7fc2cbe3-6a10-4bbf-84bd-821a06391d31 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:05.339304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7fc2cbe3-6a10-4bbf-84bd-821a06391d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:05.368772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd12601-562b-40d9-8f1e-125dfe20e268 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.412629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.413343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.413628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.413897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.414746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:05.415058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:05.416714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e6c51-2aa7-459b-b79f-85ea82ed5803 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:05.426724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 180/361] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:05.429399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef55c-f91a-4f93-9752-03cfc2a73a30 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.429569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef55c-f91a-4f93-9752-03cfc2a73a30 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.429803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ef55c-f91a-4f93-9752-03cfc2a73a30 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.436026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 181/362] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:05.437727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ef55c-f91a-4f93-9752-03cfc2a73a30 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.438239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 182/363] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:05.443186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.443186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.443186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.474955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:05.476943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:05.529749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:05.586803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ef55c-f91a-4f93-9752-03cfc2a73a30 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.607632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 183/364] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:05.608869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.613445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:05.640921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.642230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.642976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.643462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.763286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:05.764800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:05.764989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e70c2-8b0b-4a3c-8da5-4e2260f5679c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:05.813794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:05.814563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:05.814728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:05.814995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:05.829173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:05.835152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:05.836084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:05.836888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:05.837580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 184/365] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:05.838139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.886977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:05.943779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 182/366] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:05.945706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:05.981711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.038361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cca35-cde2-49d7-8c37-8a65a23b1fd8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.083069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd787-81e9-4a9d-bcc1-6c8e9ce5258f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.091413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.091629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.091857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.092234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.107910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:06.118883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:06.119879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 185/367] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:06.125359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.143891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.144444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.144717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.144985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.146466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:06.146768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.148188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.157454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 183/368] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:06.158804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.194442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.257994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3e01-95fd-4551-ad5a-4f743582dfa3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.272640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f57b-811d-4f8d-b966-2a04bf55f8af None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.285943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.298888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.300031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.300533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.301106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.302642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.304540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.307224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 186/369] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:06.308617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.309579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.310378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.310684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.310963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.311701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:06.312183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.313505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.323565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 184/370] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:06.330311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.432048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bca77-20f4-468b-a519-10e5171ec108 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.436639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.448169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9e98-9582-4732-a49b-d4f76e7417dd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.484206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.484856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.485132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.485399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.495308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.496323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.496810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.497297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.498706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.500396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.502882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 185/371] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:06.503949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.562508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.569599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.571163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.635913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba05d-caf2-43e7-8a38-f7eb3b591248 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.687437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.688803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.689097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.689372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.710970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 187/372] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:06.712203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.726347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.784324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.786495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.839579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:06.852838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8d90-6858-4231-a9a6-4942deeb961d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:06.900854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:06.901526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:06.901824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:06.902645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:06.903430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:06.903742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:06.905527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:06.914562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 188/373] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:06.915605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:06.918455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 186/374] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:06.929065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.045069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01f3a-81f3-4374-b7d7-9b478ebe8551 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.056085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:07.095877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.095877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.095877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.095877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.096304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.096304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.097319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 189/375] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:07.102992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.129910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff54c-9dc2-4a63-9d8f-15d7329243ea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.130470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:07.189490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.190416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.190835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.191615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] PATH_INFO: `/v3/projects/e527c3fb15634bdca3cbcaa63266edf3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.196013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] RBAC: Authorizing `identity:get_project(project_id=e527c3fb15634bdca3cbcaa63266edf3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.197722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.200051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 187/376] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:06 2022] GET /identity/v3/projects/e527c3fb15634bdca3cbcaa63266edf3 => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:07.205515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.233919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5de1c-c9e7-417f-9b0d-4308952166e1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.282571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.283309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.283590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.283865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.285280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.286974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.289477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 190/377] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:07.299321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.401460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc62f3-deb2-48ec-9739-30e3d579f839 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.457025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:07.474598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:07.476347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.477019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.477334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.477608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] PATH_INFO: `/v3/groups/00295dcdbffa4c9fb7a70b01b7263095` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.488142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] RBAC: Authorizing `identity:get_group(group_id=00295dcdbffa4c9fb7a70b01b7263095)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.490658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.491721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62913d6-86e3-4afb-acbd-5e570ecf635d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.493388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 188/378] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/groups/00295dcdbffa4c9fb7a70b01b7263095 => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:07.499911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.595459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.596253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.596670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.596944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.597711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=070fb9808a24437b8676aa149373541e, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:07.598017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.599648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63468d5-818e-4c3f-86cc-bf18e1784e0c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.607087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 191/379] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=070fb9808a24437b8676aa149373541e => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:07.609160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e54df-3cbd-4c66-b5d8-19a1cf6fa384 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.609463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e54df-3cbd-4c66-b5d8-19a1cf6fa384 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.609767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e54df-3cbd-4c66-b5d8-19a1cf6fa384 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.611329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 192/380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:07.618533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.620856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.621180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.635660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c869085-8bbd-460d-bda7-7140005c7d58 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.640612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:07.641875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:07.686528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.687573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.688079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.688560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.689528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] RBAC: Adding query filter params (group.id=00295dcdbffa4c9fb7a70b01b7263095, role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=e527c3fb15634bdca3cbcaa63266edf3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:07.690599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:07.692812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:07.701966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 189/381] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/role_assignments?group.id=00295dcdbffa4c9fb7a70b01b7263095&scope.project.id=e527c3fb15634bdca3cbcaa63266edf3&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:07.725421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 193/382] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:07.763527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:07.851824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:07.920164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c32b7-c312-40d9-b1de-eea835f4d39f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:07.959800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:07.960461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:07.960744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:07.961013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:07.974554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-609df78f-9b6c-4e51-83f6-ad0fd8b6950c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:07.979943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:07.980880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:07.981799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 190/383] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:07.987388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.037752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa5b-4fb8-4291-9599-a660c32d69fd None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.038095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa5b-4fb8-4291-9599-a660c32d69fd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.038303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa5b-4fb8-4291-9599-a660c32d69fd None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.039963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 191/384] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:08.052082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.052413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.052625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.087932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:08.089187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:08.184750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:08.212250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 192/385] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:08.218651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27ea5-09a3-49ef-8457-0b7852e43865 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.242964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.272006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.273766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.274042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.274350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.275053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:08.275383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:08.276811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:08.297106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 194/386] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:08.298588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.321151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:08.391112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076f42-89ac-4bfa-bac1-4b2e2558be7b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.436729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.437330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.437603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.437866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.461579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:08.464613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709f29e-b908-4186-bdc5-32648c63fa08 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:08.466745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:08.467685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:08.468468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:08.471078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 193/387] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:08.484112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.513333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.514486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.514985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.515474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.518765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:08.520580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:08.522783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 195/388] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:08 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:08.528155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.556016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:08.691801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62461796-20d8-4910-80e5-1f0fee5851fa None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.695778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:08.697355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ffc34-a2b9-412e-b870-dabb7d578ec2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.769184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.769807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.770086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.770357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.771041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:08.771371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:08.772756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:08.774703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.775405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.775682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.775949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.777920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:08.779398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:08.787589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 196/389] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:08 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:08.792245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 194/390] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:08.793877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.804864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:08.907991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:08.922035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4adbae-8630-459d-b92c-b5df60bbfa6b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:08.962474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:08.963081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:08.963429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:08.963707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:08.966101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, group_id=59ff560d1e46474aa5d45c1b2cc43818, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:08.967734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:08.989955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 197/391] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 19:20:08 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:09.010576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2a1dd-46a5-43e6-83c3-1401ded49d97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:09.055031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:09.055742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:09.056141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:09.056427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:09.057686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:09.059342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:09.061432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 195/392] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:08 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:09.067728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:09.184150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e34f-b891-49d8-aeb1-82fe2851ff9b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:09.223051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:09.223661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:09.223936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:09.224206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:09.225443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:09.226902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd924953-a722-4395-8cff-67ad7a76ec3e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:09.228943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 198/393] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:09 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:09.234956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:09.279293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:09.356122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07055f-1d5d-4294-817f-6e0d1a185f63 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:09.401840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:09.402535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:09.402818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:09.403090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/070fb9808a24437b8676aa149373541e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:09.405519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=31c351c18ffe44b597a9942e3cddb285, group_id=59ff560d1e46474aa5d45c1b2cc43818, role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:09.406933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45bef-46ba-4dff-90d5-2bc507b50e11 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:09.429386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 196/394] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 19:20:09 2022] PUT /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/070fb9808a24437b8676aa149373541e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:20:09.809376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b214d-15dd-4b5a-ab45-5a20d9124fc9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:09.809776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b214d-15dd-4b5a-ab45-5a20d9124fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:09.809969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b214d-15dd-4b5a-ab45-5a20d9124fc9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:09.811630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 199/395] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:09.817428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:09.817713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:09.817983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:09.848366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:09.849596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:09.935243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 197/396] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:09.977647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b214d-15dd-4b5a-ab45-5a20d9124fc9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:09.997815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.132028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b214d-15dd-4b5a-ab45-5a20d9124fc9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:10.175921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:10.176587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.176869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.177145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.194710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-56c36643-46c3-4622-b978-c876802c1d14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:10.200201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:10.201155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:10.202060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 200/397] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:10.208188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.271908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.328621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612ddcc-03cf-4f23-8259-5b9566e1cdc5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.328947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612ddcc-03cf-4f23-8259-5b9566e1cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.329167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612ddcc-03cf-4f23-8259-5b9566e1cdc5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.330676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 201/398] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:10.337510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43bf56-7b4f-4475-94c9-bf9a522a4c57 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.338103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43bf56-7b4f-4475-94c9-bf9a522a4c57 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.338595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43bf56-7b4f-4475-94c9-bf9a522a4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.361418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2b43bf56-7b4f-4475-94c9-bf9a522a4c57 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:10.362984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b43bf56-7b4f-4475-94c9-bf9a522a4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:10.376171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46aeb9-8184-49c1-beb6-2c5f79a0767d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:10.413565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:10.414104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.414381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.414661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.415365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:10.415668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:10.417070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3efac-7d27-4ca0-afc4-0064684c53da None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:10.436707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 198/399] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:10.438051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4617-95b1-459c-a74f-bee41e373010 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.438342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4617-95b1-459c-a74f-bee41e373010 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.438613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af4617-95b1-459c-a74f-bee41e373010 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.440152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 199/400] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:10.446767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4617-95b1-459c-a74f-bee41e373010 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.468455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 202/401] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:10.470788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.471454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.471944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.491572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.516501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:10.518721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:10.584728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.606595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af4617-95b1-459c-a74f-bee41e373010 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:10.611412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 203/402] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:10.612309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.648910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:10.649935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.650477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.650940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.656663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:10.658901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:10.664151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 200/403] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:10.667098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.756509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35997c3-2893-4c1f-add8-158fad23207a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:10.779871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574b96-3b5a-4553-9059-bde52f9a44e9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:10.791728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.798005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:10.799000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.799535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.800022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.811761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:10.818223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:10.819156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:10.820304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:10.820972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:10.820972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:10.820972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:10.820972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:10.822959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 204/404] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:10.829147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.837921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:10.848403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:10.849412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:10.850197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:10.850797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 201/405] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:10.856160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:10.880547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:10.987347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3c5d-25c4-43d7-9d56-9e9dc80be2e2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.015512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2f18-b47a-4e8a-9f8f-2ce8e11f635f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.040322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.042362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.042823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.043536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.045576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.047731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.050717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 205/406] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.051888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.053427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.054116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.054462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.054796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.055611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:11.056088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.057928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.073083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 202/407] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.073083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.141976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.158531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.186166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d074e-d185-4d6b-a751-bfa71a5c212d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.197165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df5a1-520a-4795-b2f5-59cd7f13e3fd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.223000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.223995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.224369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.224732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.227117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, group_id=59ff560d1e46474aa5d45c1b2cc43818, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.228909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.237113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.238071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.238262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.238510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.239339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:11.239634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.241214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.249622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 203/408] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 19:20:11 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:11.250410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 206/409] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.251008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.256303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.380057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297208-818c-49a8-9835-98961d4cde4f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.399571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589c43f-c8cf-4941-821d-7c70fe6785d3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.408109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.433106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.434028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.434255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.434624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.436109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.438010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.440249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 207/410] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:11 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:11.446634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.447720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.448537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.448981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.449402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] PATH_INFO: `/v3/groups/00295dcdbffa4c9fb7a70b01b7263095` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.452251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] RBAC: Authorizing `identity:get_group(group_id=00295dcdbffa4c9fb7a70b01b7263095)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.453890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.456061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 204/411] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:11 2022] GET /identity/v3/groups/00295dcdbffa4c9fb7a70b01b7263095 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.465285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.471321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.596636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfecdbe-1543-45e4-8700-5578378a769e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.625179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54eca-8589-45cb-b800-a1d580f95db9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.642584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.643255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.643539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.643809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.646791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.649701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.659475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 208/412] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:11 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.673443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.682732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.683417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.683789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.684120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] PATH_INFO: `/v3/projects/e527c3fb15634bdca3cbcaa63266edf3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.685515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] RBAC: Authorizing `identity:get_project(project_id=e527c3fb15634bdca3cbcaa63266edf3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.687113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.690194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 205/413] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:11 2022] GET /identity/v3/projects/e527c3fb15634bdca3cbcaa63266edf3 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:11.696294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:11.779381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.815841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a876d44-ef4d-41e7-a749-841154ad695d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.819052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:11.856496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.857257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.857568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.857845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] PATH_INFO: `/v3/projects/e527c3fb15634bdca3cbcaa63266edf3/groups/00295dcdbffa4c9fb7a70b01b7263095/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.859856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e527c3fb15634bdca3cbcaa63266edf3, group_id=00295dcdbffa4c9fb7a70b01b7263095, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.861666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdc7e5-229c-4d11-9ff1-6048cf3facb9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:11.891291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 206/414] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 19:20:11 2022] PUT /identity/v3/projects/e527c3fb15634bdca3cbcaa63266edf3/groups/00295dcdbffa4c9fb7a70b01b7263095/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:20:11.912056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d0e3-4188-46bc-917e-2392d5e236a3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:11.933218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b569de-7956-4d66-8d52-120df26a21ae None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.933479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b569de-7956-4d66-8d52-120df26a21ae None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.933755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b569de-7956-4d66-8d52-120df26a21ae None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.935291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 207/415] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:11.941831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.942489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.942986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.971312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:11.972575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:11.973368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:11.973487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:11.973665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:11.973946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/070fb9808a24437b8676aa149373541e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:11.979949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] RBAC: Authorizing `identity:create_grant(project_id=28ebb9d54c6d45d69fbc15885be9e406, group_id=59ff560d1e46474aa5d45c1b2cc43818, role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:11.981539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a17606-cdaf-4ac6-bf59-51b212770514 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:12.017851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 209/416] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Aug 7 19:20:11 2022] PUT /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406/groups/59ff560d1e46474aa5d45c1b2cc43818/roles/070fb9808a24437b8676aa149373541e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:20:12.019101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385372-d006-4a9b-b431-5b14d661209d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.019429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385372-d006-4a9b-b431-5b14d661209d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.019706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385372-d006-4a9b-b431-5b14d661209d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.021096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 210/417] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:12.029174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.030011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.030473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.068926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:12.070185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:12.096565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 208/418] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:12.132145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.183922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 211/419] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:12.210102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.222550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:12.267684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:12.270752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87665f-a8c5-427d-9110-5d50d6857135 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:12.312574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:12.313608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.314054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.314512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.326597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6467a5-08e9-4020-860a-1861d4228c81 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:12.327139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:12.332522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:12.333461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:12.334245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:12.336967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 209/420] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:12.345897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.411531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:12.412236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.412555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.412898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.458468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:12.463339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:12.464240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:12.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 212/421] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:12.467737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f422-cbd7-4c67-8acf-ed119fef97b0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:12.472261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.496944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:12.514416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:12.516382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.516876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.518050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.520125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:12.522274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:12.524034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:12.538808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 210/422] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:12.546679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.664366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa17e4-94c6-48f5-b23a-7358390fffd3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:12.682111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:12.702193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf2ac6-ac5b-4b00-8237-d47d535f2756 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:12.743961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:12.745217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.746155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.746620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.796292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:12.797182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:12.797594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:12.797992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:12.799019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:12.799511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:12.801722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:12.821922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 213/423] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:12.828050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:12.830607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:12.862416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:12.864018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.012329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 211/424] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:13.018219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.045465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ef5b1-d254-4b19-9673-534dc1f146cf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.132367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.133048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.133364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.133606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.155579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:13.182440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd639d26-7de3-4dbf-bab1-3830ed2f027d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.213637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:13.255602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.256375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.256653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.256924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.258107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.259687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.263624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 212/425] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:13.269267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.287027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.288586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.447837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b4a7d-0f44-43b3-96c6-6369a5f21ac6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.517505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 214/426] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:20:13.520479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.521149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.521427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.521699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.523325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.526368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.527893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.531573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 213/427] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:13.538649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.587520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:13.631719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:13.666712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c0fe4-7887-4b7b-98d5-a83cbebc3273 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.726723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.727424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.727700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.727969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] PATH_INFO: `/v3/projects/31c351c18ffe44b597a9942e3cddb285` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.729171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] RBAC: Authorizing `identity:get_project(project_id=31c351c18ffe44b597a9942e3cddb285)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.730649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.739684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 215/428] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/projects/31c351c18ffe44b597a9942e3cddb285 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:13.740786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.747999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339961-fbed-4d5c-87b6-94a431f2612b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.786153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.786688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.786965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.787264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.788027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=070fb9808a24437b8676aa149373541e, scope.project.id=31c351c18ffe44b597a9942e3cddb285) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:13.788337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.789828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5808a-56f2-43e1-91be-57be6c67b6c0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.797049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 214/429] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=070fb9808a24437b8676aa149373541e => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:13.841770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b431f8f-30ce-4aa0-abcb-ea81d684292e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.842363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b431f8f-30ce-4aa0-abcb-ea81d684292e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.842917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b431f8f-30ce-4aa0-abcb-ea81d684292e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.845769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 215/430] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:13.855554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.856043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.856532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.861055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe547595-3f09-4574-99a0-17b0b7cfffaf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:13.902624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:13.903345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:13.903622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:13.903891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:13.905176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:13.906731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:13.908797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 216/431] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:13.910042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:13.911448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:13.915692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:13.927602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.037503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 216/432] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:14.043781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08553-b4c3-4049-8828-5e06cd92c22b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:14.078403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.087322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:14.087966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.088239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.088507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.089270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=31c351c18ffe44b597a9942e3cddb285) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:14.089574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:14.091271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:14.099918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 217/433] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:13 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=31c351c18ffe44b597a9942e3cddb285&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:14.104500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.224553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf691-8f96-4c3c-abd1-f73e155afad9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:14.273627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:14.274351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.274631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.274907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.288784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:14.293739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:14.295567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:14.297834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 217/434] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:14.304355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.393615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.430342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe696-727f-4f13-8da6-f825ac99bc6a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:14.473710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:14.474348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.474622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.474887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.475692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:14.475993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:14.477410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089c91f-3635-43ba-a305-a604f01600c9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:14.487616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 218/435] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:14.493308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.549335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53956b-cc61-49ce-9205-2db923ad8633 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.549535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53956b-cc61-49ce-9205-2db923ad8633 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.549823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53956b-cc61-49ce-9205-2db923ad8633 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.551467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 219/436] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:14.557163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2caea3-faf3-4a9e-bd21-aed5a909ff08 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.557461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2caea3-faf3-4a9e-bd21-aed5a909ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.557712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2caea3-faf3-4a9e-bd21-aed5a909ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.581973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aa2caea3-faf3-4a9e-bd21-aed5a909ff08 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:14.583236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aa2caea3-faf3-4a9e-bd21-aed5a909ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:14.601401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.639867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed53d7-1d30-4a2a-add4-f7b5c7a07ec7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:14.666055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 220/437] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:14.667157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84655-9d2d-4807-a8c7-0a05468fbb95 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.667903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84655-9d2d-4807-a8c7-0a05468fbb95 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.667903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f84655-9d2d-4807-a8c7-0a05468fbb95 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.669419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 221/438] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:14.674477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.674760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.675032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.694484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:14.694931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:14.698005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.698005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.698005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.698250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:14.763519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.778901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:14.780260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 222/439] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:14.780510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:14.781107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.854871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.881880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 218/440] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:14.882064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a5ba-077f-4819-9652-7bb22571abc3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:14.882732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.915803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:14.916443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:14.916717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:14.916996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:14.927854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:14.932630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:14.933704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 223/441] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:14.934544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:14.987884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:14.990344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0114f6-b249-4f4c-97fa-70ea0f38194f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.026382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.027037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.027344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.027615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.036893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e212a2d-ed94-4bca-bccf-d83aedb5dc5e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.039358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:15.044160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:15.045290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:15.046086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 219/442] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:15.046734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.078709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.079406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.079686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.079955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.081121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.082211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.082940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.084343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 224/443] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:14 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.085130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.151918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885275ff-aa08-44c2-bdc9-3261999b2611 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.185530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8eca-bc04-4461-99f4-62e0a85a1544 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.186584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.187234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.187515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.187813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.188498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:15.188796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.190185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.198915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 220/444] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.199984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.206774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.221177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.221800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.222129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.222407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.223084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:15.223419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.224791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.232791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 225/445] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.233751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.301948 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.310264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eeb66-1074-4bf9-87e1-894dd3fd3651 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.334289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495822-b3ed-4074-a399-2c2c43995562 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.343678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.344322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.344601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.344869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.345993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.347469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 221/446] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.349847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.368841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.369459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.369730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.370003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.420046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.441653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.443145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.452926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debef8fd-8873-4af6-9151-28e05e088ebd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.487350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.487969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.488276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.488519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.520382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.543698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 226/447] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:15.544563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.559442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.560968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.626726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.647836 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98e02e-90bd-425d-9549-84796b38385a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.662421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 222/448] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:15.663304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.682944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.683526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.683811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.684080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.684808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=a8ae165c6ef74b2d8d474682dc303304, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:15.685122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.686602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.692960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 227/449] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=a8ae165c6ef74b2d8d474682dc303304 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.693967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.733675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.781334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2a1e8-dc95-4987-89b4-129207603ab0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.821706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.822857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.823135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.823440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] PATH_INFO: `/v3/projects/28ebb9d54c6d45d69fbc15885be9e406` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.824641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] RBAC: Authorizing `identity:get_project(project_id=28ebb9d54c6d45d69fbc15885be9e406)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.825813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30317d-998d-4c30-bdaf-c7668960dff8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:15.826126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.828083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 223/450] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/projects/28ebb9d54c6d45d69fbc15885be9e406 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.833643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.865593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:15.866262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:15.866540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:15.866907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] PATH_INFO: `/v3/projects/e527c3fb15634bdca3cbcaa63266edf3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:15.868140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] RBAC: Authorizing `identity:get_project(project_id=e527c3fb15634bdca3cbcaa63266edf3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:15.869473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:15.871573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 228/451] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/projects/e527c3fb15634bdca3cbcaa63266edf3 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:15.880002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:15.898935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:15.965114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e826a6-b52a-4f0a-a05d-2b3acce5b5bd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:16.001716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:16.008698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:16.009627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:16.009900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:16.010170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] PATH_INFO: `/v3/groups/59ff560d1e46474aa5d45c1b2cc43818` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:16.010958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ae0ef-7e1e-4396-b8e4-c0d5ff31877c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:16.011372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] RBAC: Authorizing `identity:get_group(group_id=59ff560d1e46474aa5d45c1b2cc43818)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:16.012858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:16.019286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 224/452] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/groups/59ff560d1e46474aa5d45c1b2cc43818 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:16.021141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:16.065097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:16.065347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:16.065563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:16.065734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] PATH_INFO: `/v3/groups/00295dcdbffa4c9fb7a70b01b7263095` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:16.068318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] RBAC: Authorizing `identity:get_group(group_id=00295dcdbffa4c9fb7a70b01b7263095)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:16.068801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:16.071016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 229/453] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Aug 7 19:20:15 2022] GET /identity/v3/groups/00295dcdbffa4c9fb7a70b01b7263095 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:16.076546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:16.151909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19b4c-de6e-4877-9cd0-bd99fa33a8e4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:16.171825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:16.189249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:16.189866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:16.190138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:16.190405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:16.191535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] RBAC: Adding query filter params (group.id=59ff560d1e46474aa5d45c1b2cc43818, role.id=070fb9808a24437b8676aa149373541e, scope.project.id=28ebb9d54c6d45d69fbc15885be9e406) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:16.191839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:16.192333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b900b31-5caa-4001-b091-a8671590dd46 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:16.193343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa9e20-5ff6-4d89-9d05-b82a6348d7c5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:16.199558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 225/454] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:16 2022] GET /identity/v3/role_assignments?group.id=59ff560d1e46474aa5d45c1b2cc43818&scope.project.id=28ebb9d54c6d45d69fbc15885be9e406&role.id=070fb9808a24437b8676aa149373541e => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:16.230378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:16.230926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:16.231228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:16.231500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:16.232273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] RBAC: Adding query filter params (group.id=00295dcdbffa4c9fb7a70b01b7263095, role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=e527c3fb15634bdca3cbcaa63266edf3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:16.232706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:16.234212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f08ff-6d55-423a-925e-f1b0a1ebea1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:16.241038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 230/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Aug 7 19:20:16 2022] GET /identity/v3/role_assignments?group.id=00295dcdbffa4c9fb7a70b01b7263095&scope.project.id=e527c3fb15634bdca3cbcaa63266edf3&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:18.747445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0eb6-09e6-486d-9d2b-810ad4812846 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:18.747947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0eb6-09e6-486d-9d2b-810ad4812846 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:18.747947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0eb6-09e6-486d-9d2b-810ad4812846 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:18.749571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 226/456] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:18.754724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbc9a9-1bf1-4b37-b31c-b0649c77f29a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:18.755668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbc9a9-1bf1-4b37-b31c-b0649c77f29a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:18.755953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbc9a9-1bf1-4b37-b31c-b0649c77f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:18.780294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a7fbc9a9-1bf1-4b37-b31c-b0649c77f29a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:18.781511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7fbc9a9-1bf1-4b37-b31c-b0649c77f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:18.865596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 231/457] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:18.897394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f0eb6-09e6-486d-9d2b-810ad4812846 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:18.974422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.023763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b05-e393-4b1a-928d-36ce646de906 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.023968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b05-e393-4b1a-928d-36ce646de906 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.024208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b05-e393-4b1a-928d-36ce646de906 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.025746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 232/458] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:19.031396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f0eb6-09e6-486d-9d2b-810ad4812846 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.049484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c448d-aa45-49d0-958d-edbf1a940b49 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.049764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c448d-aa45-49d0-958d-edbf1a940b49 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.050038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c448d-aa45-49d0-958d-edbf1a940b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.076296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e22c448d-aa45-49d0-958d-edbf1a940b49 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:19.078111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e22c448d-aa45-49d0-958d-edbf1a940b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:19.106923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.107648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.107919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.108183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.129278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.130749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:19.149578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:19.150558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:19.151893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:19.151893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.151893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:19.151893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 227/459] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:19.158416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.227426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 233/460] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:19.229138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47ad1-12e2-43e1-9672-b56e26691fcd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.229617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47ad1-12e2-43e1-9672-b56e26691fcd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.230125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47ad1-12e2-43e1-9672-b56e26691fcd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.231941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 234/461] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:19.237643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.238175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.238661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.255647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.258170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:19.260142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:19.307846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd328f08-ad17-4bc3-917f-1afd8cb9bf8a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.328336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.354657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.355491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.355870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.356288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.356655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 235/462] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:19.357134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:19.357556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.358037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.359210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.377032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 228/463] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:19.382193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.485668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40406d-c767-4d9a-9802-cfc624ece964 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.506701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3140ae8-fecf-46b1-995d-9cf171423f05 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.526110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.527097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.527652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.528158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.531381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.541353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.543165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.550448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.551159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.551614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.551944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.553249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.554820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:19.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:19.562920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:19.563853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:19.563853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.563853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:19.571465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 236/464] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:19.573195 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.595010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 229/465] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:19 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:19.596339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.649242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.746723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc946915-862a-451b-916d-013eda7dc522 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.762671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e33f8-4dba-45b3-8073-dbca56e14b49 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.794217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.794947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.795387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.795666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.805408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:19.806426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.806904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.807408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.808343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:19.808868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.810322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:19.810761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.811911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a8e5a7b9-5b81-4b79-bcd2-ac4132a8fb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:19.832267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:19.833498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 237/467] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fea1-a397-4708-9445-2f146b7641b1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fea1-a397-4708-9445-2f146b7641b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:19.834363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fea1-a397-4708-9445-2f146b7641b1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:19.835124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 230/467] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:19.837288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 238/468] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:19.838386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.841157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78fea1-a397-4708-9445-2f146b7641b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:19.894434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.954713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:19.965719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42646b-ee9f-4815-a790-71476ccfbe46 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:19.974246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78fea1-a397-4708-9445-2f146b7641b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.003640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.004683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.005216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.005700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.006606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:20.007113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.008752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f306-3c67-47c9-8302-53fcc643d5ee None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.017576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.018237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.018518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.018785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.019496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.021677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.029333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 231/469] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:20.031183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.031695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.032161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.048134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 239/470] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:19 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:20:20.055307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.056292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:20.057708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:20.195296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 232/471] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:20.240618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.258269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:20.273028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc751-0ded-46ff-957a-5528e555570e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.312442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.313419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.313872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.314345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.315363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.317395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.344951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 240/472] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:20 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:20.370613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:20.394518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0d7e-285f-4d10-bca5-2955230a0386 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.436901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.437574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.437850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.438175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.453497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.455030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7f57ae79-1da2-441e-8e4c-dbb67f60eb26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:20.472539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:20.474210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:20.475882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:20.475882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:20.475882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.475882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 233/473] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:20.480983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.597813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d692-0d5b-4485-bbf0-f219c6897211 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.598231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d692-0d5b-4485-bbf0-f219c6897211 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.598485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d692-0d5b-4485-bbf0-f219c6897211 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.599714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 234/474] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:20.607057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.607453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.607709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.630149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:20.630149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:20.642099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbf009-5ebf-4036-8b4e-37df82402c37 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.707400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.707962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 235/475] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:20.709174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.709920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.710644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.712141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:20.712969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.715914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.730609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.749986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 241/476] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:20.757715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.774543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:20.805450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:20.847216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc8533-9014-4cf0-afeb-12110909d302 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.873644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec631e-344e-43e2-906e-60043f6cf0fb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:20.885616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.886386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.886496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.886767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.887896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.888965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.900452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.sql.core [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 19:20:20.900452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 19:20:20.900452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [parameters: {'id': '763dde38e03c4dd986ebffbc899b0052', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 19:20:20.900452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80291) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 19:20:20.916306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:20.917240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:20.917690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:20.918129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:20.919021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() Aug 07 19:20:20.919382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:20:20.920293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application yield resource Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise self.value Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application session.commit() Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 19:20:20.921230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.flush() Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application compat.raise_( Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 19:20:20.922109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:20:20.922992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:20:20.923878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [parameters: {'id': '763dde38e03c4dd986ebffbc899b0052', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:20.924652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 19:20:20.925455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:20.926322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 236/477] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 19:20:20 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:20.926388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:20.928707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:20.962850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:20 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:21.115823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f180-ebd4-4d1b-b220-5f0f0e50ec54 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:21.162575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:21.174436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:21.175103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:21.175407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:21.175679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:21.193053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4849917f-a3fe-47e2-8664-ec42929fb71e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:21.197864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:21.198783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:21.199639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 237/479] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:21.205530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:21.299656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:21.339822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c1a7a-0375-42bb-9507-06262a754e99 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:21.376392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:21.377431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:21.377910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:21.378381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:21.379331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:21.379862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:21.381443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ba87-ca20-43a3-9234-72795667c39a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:21.394217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:21.917310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299f9c-11ec-4850-8a11-c2c21f8e4512 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:21.917847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299f9c-11ec-4850-8a11-c2c21f8e4512 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:21.917847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299f9c-11ec-4850-8a11-c2c21f8e4512 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:21.919503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 238/481] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:21.924733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:21.925201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:21.925276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:21.950503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:21.951783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:22.059327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 244/482] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:22.094463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299f9c-11ec-4850-8a11-c2c21f8e4512 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:22.242233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299f9c-11ec-4850-8a11-c2c21f8e4512 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:22.290311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:22.290976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:22.291294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:22.291562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:22.303830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:22.313474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:22.315707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:22.318068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 239/483] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:22.323220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:22.408981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:22.461785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5fc15-dd79-4596-9c34-0a962d11b067 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:22.520551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:22.521098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:22.521375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:22.521641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:22.522321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:22.522620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:22.524051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:22.537169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 245/484] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:22.542677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:22.613187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:22.680529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68683-fc3e-4cf2-972d-0cac6dfbcf26 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:22.726901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:22.727591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:22.727868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:22.728113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:22.740004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:22.741670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ec614281-3aff-4c6a-96aa-9bf1756163d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:22.769590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:22.771967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:22.774078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:22.774078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:22.774078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:22.774078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 240/485] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:22.780546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:22.851632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94645-dd0b-444b-8748-67dd135ef7e3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:22.851960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94645-dd0b-444b-8748-67dd135ef7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:22.852185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94645-dd0b-444b-8748-67dd135ef7e3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:22.854269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 241/486] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:22.860932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6091-5917-4216-b578-483c3b88b19b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:22.861244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6091-5917-4216-b578-483c3b88b19b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:22.861459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6091-5917-4216-b578-483c3b88b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:22.896506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8c5c6091-5917-4216-b578-483c3b88b19b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:22.897765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8c5c6091-5917-4216-b578-483c3b88b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:22.965469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6305d6-603a-424e-a774-bb7c98f16543 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.017340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.019126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 242/487] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:23.032877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d7a48-38db-4604-a90d-85aaa2e7727a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.033071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d7a48-38db-4604-a90d-85aaa2e7727a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.033432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d7a48-38db-4604-a90d-85aaa2e7727a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.041267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 243/488] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:23.041267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.041530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.041817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.045313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.046217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.046636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.047046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.048005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:23.048450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.050056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.062849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 246/489] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:23.063889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:23.064239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.065125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:23.092656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.147222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 244/490] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:23.147222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.208640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bf4-ec12-407d-a23b-42be7f1a152f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.245076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.245980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.246384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.246736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.259063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:23.259928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1964-fd8c-48db-99f5-b77d54d7a120 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:23.266095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:23.267097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:23.267934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 247/491] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:23.274009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.306961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.308100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.308595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.309032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.317931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.319665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.325802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:23.334880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:23.335871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:23.336753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:23.339444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 245/492] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:23.340499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.366542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.398623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eb0b0-5a70-45d7-9e6c-d43588dc5b7d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.451218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.451218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.451218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.451218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.460162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:23.465853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:23.467028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:23.467870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 248/493] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:23.468539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.468605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633dcc-8463-453b-baf1-3c309c7422e8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.513052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.513683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.514047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.514320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.515005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:23.515336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.516743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.528126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 246/494] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:23.529336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.585854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736dfa2-85bd-4e43-98a2-cab488927b72 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.587623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.623449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.624142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.624420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.624695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.625452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:23.625761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.627246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.629796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.650498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627d0d-e06e-4bd9-ae8b-7cf90ef6240f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.667370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 249/495] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:23.667370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.688218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.688849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.689130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.689403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.690085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:23.690386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.692268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ebe0c-2210-4f06-9ce0-1266d70712fd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.705788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 247/496] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:23.707233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98ad9-c377-401a-a51b-3c5efb77b937 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.707508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98ad9-c377-401a-a51b-3c5efb77b937 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.707813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98ad9-c377-401a-a51b-3c5efb77b937 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.711351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 248/497] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:23.711351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98ad9-c377-401a-a51b-3c5efb77b937 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.777590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ce115-c231-4cd7-b192-677881dc2b2d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.813713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.814368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.814640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.814905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.823244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98ad9-c377-401a-a51b-3c5efb77b937 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.826250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.827839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:23.843297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:23.844224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:23.845060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:23.845060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:23.845060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:23.845060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 250/498] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:23.845272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:23.862113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.868641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.869282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.869561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.869835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:23.886811 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:23.943002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:23.944513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:23.958394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1decc2-e42b-4655-9d40-7e26958989fc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:23.996464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:23.997133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:23.997356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:23.997617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.010119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.011618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e856c90f-9e9e-4a53-a03d-b6665b11aed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:24.032987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:24.033987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:24.034864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:24.034864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:24.034864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:24.034864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 251/499] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:24.035601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.035601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.035846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.055918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:24.057203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:24.060276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 249/500] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:24.061841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.110104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.127788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.140235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 252/501] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:24.141392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.183666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390ae1-870e-4106-9cb6-54ce1a168131 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.220348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.220955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.221382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.221559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.222633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:24.222633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.223903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.235356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 250/502] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:24.236193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.257828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130721b-82c1-4a4e-bf42-4ae685b9faf7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.296739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.297394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.297669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.297937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.298621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:24.298922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.300339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.312524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 253/503] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:24.313261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.356784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e995-0c37-4fad-9fb2-73ded0c009ac None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.360857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.388849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.398946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.399638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.400017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.400291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.411228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.412682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-921f46b8-406b-431d-bc10-8bdceba01fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:24.429830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:24.430787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:24.431663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:24.431663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:24.431663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:24.431663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 251/504] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:24.431663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f56c-b1f6-4ccf-83ee-598af5334f3e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.432428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f56c-b1f6-4ccf-83ee-598af5334f3e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.432428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f56c-b1f6-4ccf-83ee-598af5334f3e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.437586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 252/505] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:24.437586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f56c-b1f6-4ccf-83ee-598af5334f3e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.449828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e6c0-89c5-4b6b-85db-03bd2bd16e19 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.491485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.492432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.493144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.493421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.506557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:24.511884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:24.513094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 254/506] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:24.514102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.569308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f56c-b1f6-4ccf-83ee-598af5334f3e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.603573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.604222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.604497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.604764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.612993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.614388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.618304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c677-d46b-4fcc-b80d-db95df34ed5d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:24.631125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:24.632287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:24.633355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:24.634132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 253/507] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:24.634888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.648314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.659713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.673968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.674617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.674917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.675186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.682889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.684374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-68919132-512c-477c-9fb2-2083f7d1a2b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:24.697177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:24.698143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:24.699032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 255/508] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:24.699627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.699842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.700145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.718600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:24.719928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:24.750558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9baa9-88a4-4d8b-a3d2-c649475a7060 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.785251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.785855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.786135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.786402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.787055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:24.787385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.789141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.791345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 256/509] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:24.792267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.807760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 254/510] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:24.812630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.898586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.899301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f4599-27e9-4aa7-bcab-a8bab1ea4230 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.901978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:24.924248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce78a9-f757-4d19-8390-1848a17144cf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:24.934097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.934705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.934985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.935276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.936067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:24.936368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.937769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:24.946913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 257/511] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:24.947858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:24.961959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:24.962606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:24.962853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:24.963125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:24.963903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:24.964251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:24.965684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.007140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 255/512] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:25.007916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.062467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0740d-767e-4067-bf81-54e94aeab5dd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.099733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.100348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.100625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.100871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.101613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:25.101915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.103408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.121763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 258/513] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:25.122616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.130711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02816e-df2b-4544-bff2-1db38de5f3f2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.149967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.168283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.168940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.169219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.169488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.171559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.177781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.179406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:25.192458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:25.193419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:25.194549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.239945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1ae6-573c-4141-8385-35a0b9345d8e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.274738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.275746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.276226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.276587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.287517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.288978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:25.304148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:25.305340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:25.306493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:25.306493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:25.306493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:25.306493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 259/515] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:25.306493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.314107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0b8c6-8c40-4dc8-9ee6-25b9aee8fdf8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.361589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.362686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.363173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.363689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.382052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.384889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.387333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.410647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955313fd-a720-4b43-8da3-d1b3d087a144 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:25.411058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:25.411958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:25.412796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:25.412796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:25.412796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:25.413479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 257/516] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:25.414849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.449691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.450315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.450581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.450845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.489555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.521063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.522575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.550803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d3d00-24d3-4d0f-9dc7-82f9f74d8923 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.592342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.592970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.593257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.593518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.605891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.631046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 260/517] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:25.631766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.665709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.667108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.714072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.732340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101497-661a-4323-9b6f-bd4da6debde3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.767537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.768155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.768425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.768690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.768848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 258/518] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:25.773530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:25.773530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.773698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.773769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.790657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 261/519] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:25.791540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.826382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.876451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db647f-e891-4bc6-a525-0eb69e056776 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.895127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d5ad4-9836-4347-a3a5-f15eea8530bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:25.911856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.912482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.912756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.913025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.913674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:25.913973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.915406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.927020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 259/520] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:25.927888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:25.931212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:25.931862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:25.932139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:25.932404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:25.933047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:25.933346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:25.934731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:25.937647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:25.947122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 262/521] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:25.947998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.037312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080257-8c62-4ea4-ab22-2faeadbac4fe None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.047804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.054333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ff517-8046-4117-b4e5-5c9ee17f13e1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.072038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.072678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.072954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.073222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.084594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.086062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.088858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.089490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.089763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.090028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:26.100257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:26.101360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:26.102556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:26.102556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:26.102556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:26.102556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 260/522] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:26.102556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.107790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.109258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:26.124337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:26.125634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:26.126472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:26.126472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:26.126472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:26.126472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 263/523] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:26.126472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.169702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.212484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d30b3-a315-4182-a6b9-aad6905af780 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.232235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3784241-8af6-495a-adfd-0036fec08b98 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.248083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.248929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.249209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.249478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.250288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:26.250607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.252065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.257658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 261/524] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:26.258450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.268961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.269598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.269959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.270234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.270892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.272446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.307232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 264/525] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:26 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:26.307232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.309734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.415437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247446-b678-4239-a29f-ba2c8abe6d78 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.456683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.457845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececfeb8-c268-4817-8459-e692e0e66470 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.471157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.472116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.472551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.472976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.482220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.483784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:26.498627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:26.499588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:26.500466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:26.503376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 262/526] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:26.503376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.508782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.509653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.510074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.510497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.511354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:26.511799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.513957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.527779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 265/527] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:26.528654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.614814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.641790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef4451-19e2-4e04-8de4-c4fe3c936542 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.662449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f666db-58a2-4d8b-b3e6-fd0db1aed670 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.688218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.688999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.689377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.690002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.691558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:26.691967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.693971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.703075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.703944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.704389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.704807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.705719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:26.706189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.707803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.709907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 263/528] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:26.715286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.728772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 266/529] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:26.730018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.786733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.846050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80a78-1680-4ed6-9269-ffd6c1bc1779 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.871286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05d32d-8c94-4bc7-a55d-eff318d6e7ef None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:26.884526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.885301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.885573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.885844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.893799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.895397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.899538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:26.910303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:26.911424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:26.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:26.918599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:26.918599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:26.918599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:26.918599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:26.919375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 264/530] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:26.920636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:26.924335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:26.925974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:26.938861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:26.939973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:26.941005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:26.943137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 267/531] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:26.944205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.041550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f517a7-e683-40b3-9a1c-814c371f78fd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.043823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:27.059743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1068b9d-d89c-4e14-9170-bbfecf115bfb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.088683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.089313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.089610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.089892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.107095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.108807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.109635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.110581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.111581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:27.112079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.114267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.133737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 268/532] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:27.134689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.179555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.182255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.183156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:27.261033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bc2d-f28f-48a7-8a1a-5fb4b2c590a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.304607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:27.311237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.311721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:27.316943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.317581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.317857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.318127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.318843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:27.319154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.320681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.340762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 269/534] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:27.342287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.445651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5cbf-3d01-4550-9122-88a196617466 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.475800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9eb9f-2197-499a-b1a4-fbf1725f1bf1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.477839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:27.484975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.485787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.486159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.486525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.488059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=ad86d22df95d41c4b328c1e6c19381c8) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:27.488486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.490502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.507251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 266/535] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/role_assignments?user.id=ad86d22df95d41c4b328c1e6c19381c8&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:27.507251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.537219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.537881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.538219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.538492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.551884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.553521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:27.571922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:27.576602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:27.577514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:27.577514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:27.577514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:27.577514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:27.577514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.657254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:27.748491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81ddce-d8ce-4860-a811-6701dd884512 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.768701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f0105-ad95-4713-a030-4ac403f30a15 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:27.809159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.810694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.811380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.811867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.812841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:27.813345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.815342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.832158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 271/537] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:27.840737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:27.849009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:27.849650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:27.849924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:27.850244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:27.850989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=1daf3ae711f0440ca0b26d214a162074) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:27.851374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:27.852830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:27.863255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 267/538] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/role_assignments?user.id=1daf3ae711f0440ca0b26d214a162074&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:27.867521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:28.007074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e098b-b012-4a23-8700-6b1221009c26 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:28.060100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:28.060849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.061129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.061394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.069819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:28.071314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:28.083890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:28.084787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:28.086069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 272/539] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:28.091237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:28.245884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadf126-d19c-47b8-94e2-7ac3cb4849ea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:28.319459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:28.331953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:28.333498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.334348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.335062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.336701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:28.337553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:28.340638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a47fcd-211c-43f7-9306-10c7c37a9193 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:28.381668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 268/540] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:28.387091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:28.431340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7b54-d386-40d6-b77b-42f4e49f4a67 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.431695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7b54-d386-40d6-b77b-42f4e49f4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.431879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7b54-d386-40d6-b77b-42f4e49f4a67 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.433540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 269/541] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:28.439273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.439589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.439833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.475761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:28.477046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:28.494654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:28.537321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c43a-eb90-4b4b-a612-f96de532a6a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:28.556907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 270/542] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:28.592306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:28.593147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.593252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:28.593434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.593708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.594458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=ec7f568319844b9fbd05f7936d439b56) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:28.594770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:28.596900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361470-98dd-4fca-aa3d-952ebb152c1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:28.604157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/role_assignments?user.id=ec7f568319844b9fbd05f7936d439b56&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:28.683305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eeed-0063-474e-a1d9-659288022601 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.683760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eeed-0063-474e-a1d9-659288022601 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.684170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eeed-0063-474e-a1d9-659288022601 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.687122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 274/544] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:28.693668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.694112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.694580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.714592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4238eb-30ac-4941-9608-ce7f015f94f7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:28.714870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:28.716135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:28.743586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:28.755046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:28.755748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.756027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.756297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.767977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:28.772856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:28.773809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:28.774624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:28.781780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:28.805901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 275/546] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:28.844786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:28.926083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9109-5731-49a9-b219-2968ab24beef None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:28.965305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:28.965946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:28.966220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:28.966488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:28.967266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:28.967573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:28.969154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:28.978861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:28.991352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:28.992582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.041965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:29.078240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec194e4f-7f36-4d00-900a-1d5be9815f52 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.103821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8848c9-f706-4525-9962-c71454a4e231 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.140743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.142170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.142640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.143049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.154833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.156568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:29.171640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:29.172583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:29.173450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:29.173450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:29.173450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:29.174376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.175040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.175344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.175611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.176605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 273/548] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:29.183357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.200509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:29.205311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:29.206391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:29.207990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:29.219224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 276/549] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:29.226116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.361759 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:29.372632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586c15-79cf-46dd-950c-f7389ca0d43a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.381137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f50e-864e-4903-99cb-4d8aa53a38a3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.439881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:29.450735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.451426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.452634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.452908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.453566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:29.453866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.455363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.458363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.458985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.459320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.459591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.460557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:29.460866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.462528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.488776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 277/550] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:29.491777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.494212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 274/551] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:29.506929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.642970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3d9c-dac8-4e5f-8f81-4197be2be264 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.681016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.681663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.681936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.682202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.694365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.696100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.700435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7580-01ba-41c9-8a8b-88becf3c01ce None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:29.712926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:29.715054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:29.716699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:29.716699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:29.716699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:29.716699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 278/552] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:29.722588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.748623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.749398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.749741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.750075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.758006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.759607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:29.778078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:29.780367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:29.782515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 275/553] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:29.789936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.825232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:29.825585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:29.873103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a036-90ad-4df3-ba83-16741b66d61d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:29.908078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:29.908603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:29.908880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:29.909148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:29.909798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:29.910093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:29.911517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:29.925040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 279/554] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:29.930534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:29.997117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b0a5c-6d7e-437a-be4a-c7ed5020812b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.043601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.044241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.044569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.044933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.045924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:30.046085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.047565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4223-5fab-455a-b9d6-939430ce6ea8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.061667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff4dde-62b9-43d2-873a-038b2bf4b63d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.063449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.076089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 276/555] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:30.079992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db7f7-6de0-4a8e-b21f-6dd89d50be21 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.080280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db7f7-6de0-4a8e-b21f-6dd89d50be21 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.080546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db7f7-6de0-4a8e-b21f-6dd89d50be21 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.086145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 277/556] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:30.086145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24db7f7-6de0-4a8e-b21f-6dd89d50be21 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.117322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.118498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.118918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.119537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.129703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.131525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-61de75c2-5588-4220-a160-b823d70f822f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:30.148371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:30.149492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:30.150866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:30.154125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 280/557] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:30.155841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.156932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.157587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.176076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.185257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:30.187417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:30.216073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24db7f7-6de0-4a8e-b21f-6dd89d50be21 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.255829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.256430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.256671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.256939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.268105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.269370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:30.286801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:30.287808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:30.288813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:30.288813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:30.288813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:30.288813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 278/559] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:30.288813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.289626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 281/559] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:30.292922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.410253 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c08379-7f85-46a3-a096-e78cebb405a6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.418918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.432482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09141f-c4b4-42ee-b042-1bb99bd3731f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.445540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.459046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.459700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.459972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.460242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.461174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:30.461475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.462920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.483034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.483642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 279/560] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:30.484344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.484766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.485236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.485696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.486576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:30.487539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.490322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.506831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 282/561] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:20:30.508621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.594606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad240cd-f491-4b1c-a6a4-985001e55a86 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.628353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071ce4a-955c-4702-89a1-a7c627a7c73e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.631438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.632099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.632363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.632625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.643724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:30.648433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:30.649415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:30.650279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 280/562] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:30.650988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.671029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.672077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.672528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.672961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.699324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.705730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.757451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.759358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.777453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5fd4-3363-4cf8-9aad-65e25e55c872 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.835357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:30.836019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.836296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.836577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.844884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:30.846374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e52eedef-09da-49ce-ae26-612b646038bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:30.861235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:30.862198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:30.863097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 281/563] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:30.864380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824d22-0a2d-4ed8-bc67-5f394a71053c None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:30.864482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824d22-0a2d-4ed8-bc67-5f394a71053c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:30.864996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824d22-0a2d-4ed8-bc67-5f394a71053c None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:30.871465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 282/564] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:30.871465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824d22-0a2d-4ed8-bc67-5f394a71053c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.887242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 283/565] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:30.887242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:30.956158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:30.995061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824d22-0a2d-4ed8-bc67-5f394a71053c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:30.996762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.013466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072065-a7b5-4a31-8e2a-829c3471e74d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.041671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.042343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.042633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.042912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.043639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:31.043932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.045326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54972fdf-948d-47c3-87b7-705fba89387d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.054793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 283/566] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:31.056086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6c54-abdc-411f-9bf3-bfe9f18e039c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.056368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6c54-abdc-411f-9bf3-bfe9f18e039c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.056641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6c54-abdc-411f-9bf3-bfe9f18e039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.058137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.058811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.059612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.059612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.060247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:31.060644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.062110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.074403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 284/567] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:31.076612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.076769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cacc6c54-abdc-411f-9bf3-bfe9f18e039c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:31.077005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cacc6c54-abdc-411f-9bf3-bfe9f18e039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:31.145309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 284/568] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:31.146588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e36ba-edff-41c6-98e7-250c985dcafa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.146858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e36ba-edff-41c6-98e7-250c985dcafa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.147132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e36ba-edff-41c6-98e7-250c985dcafa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.151345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 285/569] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:31.152393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e36ba-edff-41c6-98e7-250c985dcafa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.196237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a116-cba4-464e-beee-f865fe3db435 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.209476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.234661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.235334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.235607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.235871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.246768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.248340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.263965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:31.264381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:31.265588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:31.266592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:31.266592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:31.266592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:31.268675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 285/570] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:31.268675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.273745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e36ba-edff-41c6-98e7-250c985dcafa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.312104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.312764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.313054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.313308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.324947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.326524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d05a4d9e-a89d-4368-82d2-ea29cfbc09d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:31.342966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:31.344263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:31.345210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:31.345210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:31.345210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:31.345210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 286/571] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:31.345441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.345661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.345953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.365739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:31.366988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:31.382275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b427c5-b5cd-4d96-abfa-5048ffc049c9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.418002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.418772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.418939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.419234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.439045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=31fcd522972b4af7ab786a11af6938f6, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.439605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 287/572] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:31.440458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.440545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.461859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 286/573] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:31 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:31.462625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.481566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.535535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.564695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb62f-5cfe-4189-a856-73b0fac45edb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.581167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea042-b7bc-472c-b390-0da1bc3561d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.605598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.606389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.606730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.607068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.619750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:31.620826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.621467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.621728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.622092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.622653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:31.622951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.625621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:31.625787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:31.626875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:31.627855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:31.633230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 288/574] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:31.633230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.640881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 287/575] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:31.641882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.721405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.749332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff74b0-6d54-4f9d-afdc-0ab8d5a8a322 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.755892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c8915-da36-41cd-80fd-5f163ba82cc6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.785284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.785997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.786314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.786472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.795360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.795974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.796326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.796554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.797159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:31.797455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.797545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:31.798831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.801773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:31.803061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:31.804209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:31.805279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:31.807137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 288/576] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:31.808078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.818381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 289/577] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:31.819504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.917344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270878-f26d-4b8e-a122-812f08b5e9a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.926993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a716-fd52-4f8b-a2d2-de96c48b6f7d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:31.957905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.958522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.958942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.959068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.959749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:31.960047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.961444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.963071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:31.964644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:31.965432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:31.965801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:31.966173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:31.972223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 289/578] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:31.972850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:31.978626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:31.980147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:31.992238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:31.993156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:31.994034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 290/579] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:31.995318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.062916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.083374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3081b-7447-46fc-9e87-0bb4b05a1529 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.112520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30918f6-7796-4e42-9daf-d3273bdb2923 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.118925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.119580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.119855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.120132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.120808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.121110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.122487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.130789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 290/580] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.130789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.155564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.156712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.157023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.157292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.166102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.167615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:32.180215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:32.181201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 291/581] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:32.182260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.208758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.260857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8f22b-6f8c-4741-b2bd-2e7ac68bef66 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.312161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.313138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.313591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.314033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.315111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae64473-a61b-421f-a89b-7e01cfb1c302 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.332012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.334916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.342702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:32.359290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:32.360351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:32.361297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:32.361297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.361297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:32.361297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 291/582] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:32.362176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.378440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.378986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.379286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.379546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.380245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.380549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.382105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.401015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 292/583] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.401015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.482450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a73b8-32f4-4f15-859d-3e3da6e839b3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.494388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.514264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa45b-01ac-450d-a61c-f987c6461167 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.522447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.523174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.523540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.523877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.536500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.538176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.550097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.550791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.551128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.551480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.552382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.552663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:32.553674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:32.554669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:32.555733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:32.555733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.555733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:32.555904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.559354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 292/584] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:32.561136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.579799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 293/585] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.579799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.614499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.670731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44b7eb-4344-429e-9685-f20801022428 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.684606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06299c-21f5-4ff5-800f-afe78f98726a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.713758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.714379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.714660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.714922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.715707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.715981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.717300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.722707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.725654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.725654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.725654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.725654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=d5d8b65b2e324e9c9cbb4e18c715f4da) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.725654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.727451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.730183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 293/586] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.743356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 294/587] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/role_assignments?user.id=d5d8b65b2e324e9c9cbb4e18c715f4da&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.743356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.743694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.773220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.871127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:32.875819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e49a9-60c1-464d-b91d-149ae18ee82c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.887530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0fbc-9031-49bb-8dea-45b7fc95eb6a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:32.919222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.920334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.920921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.921288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.926765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:32.927691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:32.928113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:32.928526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:32.929353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:32.929819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.931395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.934248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:32.935940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:32.945182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 294/588] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:32.946387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:32.952287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:32.953258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:32.954488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:32.954488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:32.954488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:32.954488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 295/589] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:32.954739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.049541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.070481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a298e8-17df-419b-9d12-35eb41b08cb7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.094435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd9d50-7472-4f72-8541-5ce905ac4b02 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.114515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.115168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.115480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.115745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.124473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.125933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:33.138401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:33.139541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:33.140465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:33.144331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 295/590] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:33.144936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.145251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.146158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.146627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.147088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.157206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.159241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:33.172137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:33.173127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:33.174058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:33.176712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 296/591] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:33.177726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.192081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.257746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42010098-0644-4568-a718-e439a1fe72bb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.295348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a750e4c-72e0-4384-b1f1-e98c3a1793af None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.295776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.296411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.296686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.296973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.297632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:33.297932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.299355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.319495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 296/592] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:33.320537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.323663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.334979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.335648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.335986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.336299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.337524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:33.337935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.339428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.362161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:33.363532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.442584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cc61-3713-484e-932d-95019dec2e04 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.478728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.479651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.479927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.480204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.480945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:33.481243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.482739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.488268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.506582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:33.507330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.530745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f774-d9dd-47a9-9699-9dc0a689661c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.571337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.575383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.576053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.576459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.576692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.584614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.585276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9de5a2cc-c33f-4857-a748-5cb5d2968c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:33.596870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:33.598218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:33.599344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a92d-5d2f-4659-a123-0f9096fea47e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.599879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a92d-5d2f-4659-a123-0f9096fea47e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.599879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a92d-5d2f-4659-a123-0f9096fea47e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.601344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 299/596] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:33.601987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a92d-5d2f-4659-a123-0f9096fea47e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.624338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca9405-37f8-4fdd-80d8-0f37909485c8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.661480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.662130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.662405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.662675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.673397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.674889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:33.691617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:33.693535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:33.695368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:33.695368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:33.695368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:33.697412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 298/597] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:33.698316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.726528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a92d-5d2f-4659-a123-0f9096fea47e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.758332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.776482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.777156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.777454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.777726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.791332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.792989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ff800349-9dff-478a-a82f-68c05b1954be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:33.809380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:33.810652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:33.811690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:33.811690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:33.811690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:33.811690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 300/598] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:33.812307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.812589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.812862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.832414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:33.833607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:33.835064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a832c-485a-4b8b-b45e-d825f72f427b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:33.853649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:33.880422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:33.881053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:33.881332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:33.881603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:33.882313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:33.882622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:33.884109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:33.904153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 299/599] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:33.904153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:33.928621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 301/600] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:33.928621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.048523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663de6-b963-4dac-ac93-45101e946a9c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.056480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156aeb5-caf3-4e7b-aa84-11dd2baabec4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.068975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.088869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.089410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.089689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.089960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.090688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:34.090996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.092534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.099420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.100062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.100339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.100604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.101267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:34.101564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.102998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.105608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 300/601] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:34.106499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.121327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 302/602] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:34.126818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.141924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.217702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc6bb-b4b0-43f7-a336-88de0e56ba40 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.236502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b9236-03cb-411f-80fd-02d6c843820c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.256999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.257692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.257965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.258214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/ad86d22df95d41c4b328c1e6c19381c8/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.273026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.273649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=ad86d22df95d41c4b328c1e6c19381c8, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.273784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.273945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.274203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.275110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.285953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:34.291634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:34.299849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 303/603] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:34.300764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.301545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 301/604] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:34 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/ad86d22df95d41c4b328c1e6c19381c8/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:34.301545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.345601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.404117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.426525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96904749-ffaa-42f1-bb05-e92bf01862d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.442095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d24d4-120d-4a6a-b94f-a2f813ed9f93 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.471080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.471858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.472132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.472395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.479957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.481336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.481510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.482137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.482414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.482751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.491514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.492990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:34.496402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:34.497332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:34.498649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 302/605] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:34.499130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:34.506542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:34.507516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:34.509516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 304/606] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:34.513452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.605572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb000-bb53-4ad5-9ae9-491d054bb2a8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.613372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.624259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0768fb-c1c0-481e-bf23-c9874782fdc8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.644993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.645617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.645893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.646222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.647522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:34.647829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.649765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.661699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 303/607] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:34.662580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.666264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.667834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.668777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.669259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.669690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.670924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:34.671403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.673926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.688839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 305/608] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:34.690146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.801528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea920-9865-46b7-aafd-7f8f6d7267ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.812409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b25fe4-c442-4b69-850d-aa28727f6353 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:34.844753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.845370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.845640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.845903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.846596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:34.846896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.848505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.849109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:34.849751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.850132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.850402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.865489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 304/609] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:34.865489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.867281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:34.868753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a5dfe490-5df0-4ad6-8c5d-3a3c13eac373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:34.885197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:34.886433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:34.887448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:34.887448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:34.887448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:34.887448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 306/610] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:34.887692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a562-02de-49d4-ba08-afe640b2fa2b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:34.887898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a562-02de-49d4-ba08-afe640b2fa2b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:34.888087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a562-02de-49d4-ba08-afe640b2fa2b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:34.891505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 307/611] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:34.892548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a562-02de-49d4-ba08-afe640b2fa2b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:34.896241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.935718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:34.977800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ab9f-f701-4a93-a4ed-dd1d57aaacc7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.003038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a562-02de-49d4-ba08-afe640b2fa2b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.014990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.015705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.015966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.016400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/ec7f568319844b9fbd05f7936d439b56/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.033514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=ec7f568319844b9fbd05f7936d439b56, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.035076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.039582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.040230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.040573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.040856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/1daf3ae711f0440ca0b26d214a162074/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.052217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 305/612] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:34 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/ec7f568319844b9fbd05f7936d439b56/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:35.053172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.072313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=1daf3ae711f0440ca0b26d214a162074, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.074390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211b18e-f706-479c-b6d3-4ae49c5104ed None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.093125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 308/613] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:34 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/1daf3ae711f0440ca0b26d214a162074/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:35.094971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.096719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.097263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.130944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:35.133815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:35.231586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:35.282215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 309/614] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:35.291694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6211a-0333-4da6-a37f-84fc3e56bc85 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.306362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.308548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:35.341555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.342276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.343073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.343383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.344057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:35.344364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.346053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.363301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 306/615] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:35.371966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.447227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a324268-dde1-4baa-ba39-0a6220faefe0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.484733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.485410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.485687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.485955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.498746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:35.502689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98770c0-2bcb-4790-9320-722102f6ac2d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:35.503643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:35.504582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:35.505809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 310/616] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:35.511106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.544312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.545964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.546450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.546942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.555789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.557750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.572955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:35.575065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:35.576023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:35.577029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:35.587324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 307/617] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:35.591825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.664565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:35.692721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cbb9-e945-4519-aece-09af5e7c9eb8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.749340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.750359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.750856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.751356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.752338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:35.752830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.756573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.769292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 311/618] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:35.775003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.802909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41028c6-d66d-4136-88fb-fd25de30d27f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.846650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:35.852007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:35.852524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:35.852981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:35.853923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:35.854422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:35.856580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:35.888382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 308/619] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:35.898126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:35.978364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc11e1-0658-4b58-8906-388e894e2c59 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:35.988421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.018310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.026006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7e945-d417-43a9-916a-39fd5c830926 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.062123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.063159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.063734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.064267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.071848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.072487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.072767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.073037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.093247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.094749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:36.127081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:36.128213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:36.129116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:36.129116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:36.129116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:36.136894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 312/620] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:36.157095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.189301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.191642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.311071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 309/621] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 19:20:36.311604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.317172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.410992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d275e02-7b03-412a-a79a-c1e34a100b11 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.446362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb12959-c98d-4a91-9c06-0136c38a1118 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.466149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.466775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.467094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.467411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.468666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:36.468982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.470646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27738613-862c-40ff-9f53-7cce9fd76bbe None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.484550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.485206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.485480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.485744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.487230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 313/622] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:36.489524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14e96-a344-4c24-b164-61a76fda26dc None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.489811 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14e96-a344-4c24-b164-61a76fda26dc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.490089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14e96-a344-4c24-b164-61a76fda26dc None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.491796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 314/623] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:36.492703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14e96-a344-4c24-b164-61a76fda26dc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.505334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.506759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.516517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-03324f86-413c-4bba-a9f4-733c174b7d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:36.527938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:36.528972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:36.529910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:36.529910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:36.529910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:36.531688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 310/624] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:36.533087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.533561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.533842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.564062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:36.565274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:36.609448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.640466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 311/625] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:36.641477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.654818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14e96-a344-4c24-b164-61a76fda26dc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.703718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.704563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.704728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.704877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.713903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.715416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:36.734473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:36.736726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 315/626] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:36.739083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.787577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbd6a0-5ce3-48b1-9093-7d4350a1fefa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.829575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.830280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.830716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.831051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.831834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:36.832206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:36.833799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:36.848507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 312/627] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:36.849517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.857970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.893300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877438f-4669-46aa-b0a3-3b73fcf6a25a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:36.898228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:36.945902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:36.946861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:36.947324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:36.947734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:36.962988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:36.970725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:36.971947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:36.973018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:36.981055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 316/628] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:36.981055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:36.987082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756480a6-4ab8-4e98-8953-9bc98a610223 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.032353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.033365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.034028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.034512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.035857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.036554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.038365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.069613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 313/629] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.070821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.103952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c60f-e831-4b69-ae05-d5d93a23ac66 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.153826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.155916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.156424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.156893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.161252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.168738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.171282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.178035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.189530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea018f-0692-40d4-99aa-7e893f2501f1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:37.190682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:37.191992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:37.192923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 317/630] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:37.198620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.236495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.237276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.237557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.237827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.238792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.238969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.240360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.254836 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 314/631] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.254836 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.336525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db6f1-2857-451f-99c4-3083e5db685b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.372908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.373512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.373791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.374064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.385419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.386899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.387944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579d2a-c771-4c3a-8155-77b45d65b6c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:37.402497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:37.403560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:37.404500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:37.404500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:37.404500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:37.407467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 318/632] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:37.408437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.432398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.433062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.433293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.433559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.434257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.434558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.436063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.449076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 315/633] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.454638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.470776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.472080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.531715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3ccc-8f8a-4092-8644-23bd3a4ef63f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.564286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247933b0-5c30-4149-ba2e-1cdb2ddec27b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.566465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.567137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.567446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.567717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.578781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.580310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d3f4d93e-0a46-4702-9fbf-5dc2993cb600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:37.595120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:37.596144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:37.597044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:37.597044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:37.597044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:37.597044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 319/634] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:37.597457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4725-eba9-447b-bf71-2401f5e89ae1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.597669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4725-eba9-447b-bf71-2401f5e89ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.597935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce4725-eba9-447b-bf71-2401f5e89ae1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.599309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 320/635] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:37.600000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4725-eba9-447b-bf71-2401f5e89ae1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.604164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.604793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.605070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.605343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.605998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.606300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.607778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671729-220f-4bed-9c2d-781729e9a197 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.619286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 316/636] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.620533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035aed-b855-4f4a-a56d-c8de8f0a29df None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.620843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035aed-b855-4f4a-a56d-c8de8f0a29df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.621092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035aed-b855-4f4a-a56d-c8de8f0a29df None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.622292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 317/637] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:37.623734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.623734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.623934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.641884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:37.643105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:37.708499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.711214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 318/638] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:37.712169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.716485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:37.720977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce4725-eba9-447b-bf71-2401f5e89ae1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.758482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.759087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.759403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.759670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.760406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.760708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.762165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.768031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 321/639] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.768831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.832420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26a0db-7ef4-4dfe-ad96-7f35b8e468e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.871258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.871991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.872430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.872869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.873940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:37.874289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.876070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0121-2901-435d-b214-ce5db904b123 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.886077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e1559-1e38-44e2-80c4-0375a830d9f4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:37.889479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 319/640] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:37.891161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.891670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.892123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.923747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:37.925055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:37.934170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:37.934842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:37.935117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:37.935441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:37.943580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:37.944956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:37.958061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:37.959020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:37.959986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:37.961177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 322/641] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:37.961177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:37.989689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.004200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.011921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 320/642] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:38.012805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.080770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a916a35-49e0-49d8-b7dd-df3470a3ec81 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.116137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.116783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.117095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.117331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.118540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8085d9-d081-4c53-a11c-6a904c55d210 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.128143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:38.133251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:38.134263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:38.135108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 323/643] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:38.135849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.159425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.160330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.160767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.161208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.168698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.170193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:38.182114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:38.183142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 321/644] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:38.189321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.231611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.247139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.250131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67dc1-2631-468f-ac32-614f6935f101 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.285820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.286637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.287010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.287412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.288124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:38.288432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.289899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.294625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec37d95-7624-4616-955b-0bc3288f0206 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.307851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 324/645] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:38.307851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.339367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.340358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.340812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.341295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.352794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:38.358675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:38.359693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:38.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:38.363376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 322/646] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:38.364448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.415223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a87a-6534-4feb-8fdc-6ee7d5e86774 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.456615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.457186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.457468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.457739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.458424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:38.458777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.460271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.473315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 325/647] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:38.473315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.481301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d007e-12c2-4a10-b9b5-9a6f62e245fb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.482308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.500240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.524049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.524851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.524979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.525215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.525964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:38.526271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.527753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.553135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 323/648] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:38.553135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.596021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f429f-19f6-4657-bc1f-d9bcf6e2dbff None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.638110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.639093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.639414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.639698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/d5d8b65b2e324e9c9cbb4e18c715f4da/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.658218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=d5d8b65b2e324e9c9cbb4e18c715f4da, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.660183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.673112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fd03-2843-4c02-bce9-4d69f316a73c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.677116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 326/649] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:38 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/d5d8b65b2e324e9c9cbb4e18c715f4da/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:38.677682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.725347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.726500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.727325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.728395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.729638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:38.730179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.731858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.746410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 324/650] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:38.747759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.766592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.799926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:38.825918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b16929-32c7-4dfb-87ea-003770a7d8bd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.868355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.868355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.868355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.868355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:38.883680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:38.885187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:38.897116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20c078-0689-44aa-94da-10c6c964c453 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:38.901461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:38.903241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:38.905017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:38.905017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:38.905017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:38.907385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 327/651] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:38.908326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:38.955002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:38.955608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:38.955884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:38.956151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.050583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd272cd-9987-4af9-a8fb-2fc14db1c706 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.060931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.062420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.064645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.090100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.090954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.091334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.091680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.104071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.105742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.108128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:39.124326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:39.125557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:39.126596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:39.126596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:39.126596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:39.128405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 328/652] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:39.129594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.195291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 325/653] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:39.196448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.263387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a200eb2-4d89-4a38-9e3a-9c4062905c6d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.300443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.301423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.301852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.302273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.303072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:39.303555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.305375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.314109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4b81a-8904-4f74-8483-d3e40a32adb5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.332440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 329/654] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:39.336092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.357156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.358025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.358378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.358720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.359501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:39.359865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.361290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.363126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.367322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.376530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 326/655] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:39.377598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.473350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f12a-41b4-4e4b-8187-743bd45f5baf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.491666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d0782-a37f-4397-b4f1-86633e2ece37 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.526736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.527345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.527620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.527887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.537663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.538932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.539044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.539599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.540114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.540874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.551074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.553303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:39.556726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:39.557672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:39.558589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:39.558589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:39.558589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:39.558589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 330/656] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:39.559288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:39.570936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:39.572154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 19:20:39.573349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:39.576656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 327/657] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:39.577833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.637418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.675653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.689698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd3-ae09-4ea2-86d2-233e7aa3ca0f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.708690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fc8d-6d74-427c-a298-2bf6d030d79b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.729278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.729912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.730184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.730449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.731110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:39.731463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.732999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.747963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 328/658] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:39.749042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.759686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.760366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.760831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.761616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.772639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.775111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:39.792175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:39.793165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 19:20:39.794131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:39.794688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 331/659] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:39.796581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.873799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914723-dfa0-4ac4-978b-c1aed099484b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.890585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.914232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.914925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.914925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.915067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.916013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:39.916390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.918056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.930387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a82a7-1a4f-42ea-8511-988995cba486 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:39.938626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 329/660] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:39.942562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:39.964895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:39.970621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:39.971297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.971574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.971841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.978794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:39.980282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-27c75a27-72b0-435a-9eb1-9506174bb0dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:39.991648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:39.992641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:39.993613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 332/661] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:39.994090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c264-f66e-4de8-92ee-cafab9bc18e1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:39.994561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c264-f66e-4de8-92ee-cafab9bc18e1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:39.994657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c264-f66e-4de8-92ee-cafab9bc18e1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:39.999342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 333/662] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:39.999342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c264-f66e-4de8-92ee-cafab9bc18e1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.072875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380340c-bdb3-4836-b41f-cf3a9e5e4d2d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.112404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c264-f66e-4de8-92ee-cafab9bc18e1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.116380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.117314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.117776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.118228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.119027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:40.119572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.121742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.146573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 330/663] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:40.147669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.148134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.148938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.149389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.149814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.185306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.226047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.236776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.238391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.276445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffedf8-b3cd-419b-85f3-563cdb44520d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.328992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.329732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.330014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.330423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.331145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:40.331500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.333005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad42b77-0153-4ee3-9a6f-3e6c7c218595 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.357246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 331/664] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:40.357246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.357246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.357246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.372605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:40.373955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:40.394172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 334/665] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:40.394172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.475378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 332/666] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:40.475378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.496323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.498817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.508641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe44c-4cca-482a-b633-594714e09c97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.547829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.548568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.548847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.549118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.584996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32201a-1cf3-4e9f-88da-8d2ed421561c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.622820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.623892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.624331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.624688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.625928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=ad86d22df95d41c4b328c1e6c19381c8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:40.626355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.628824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.630011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.632827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.637783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 333/667] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/role_assignments?user.id=ad86d22df95d41c4b328c1e6c19381c8&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:40.639142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.757112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.775663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:40.784090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5914c5-2fc8-46c1-a165-3a43f1b379cd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.789155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 335/668] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:40.789466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.833225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.834197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.834481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.834749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.846034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:40.847460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:40.862173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:40.863256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:40.865394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:40.865394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:40.865394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:40.867347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 334/669] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:40.869025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.903403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029e11e-70be-42bc-ba4e-1a4203d6ecb5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:40.939187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:40.939890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.940168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.940439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.953282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ee3174af-28f6-4805-9872-467aca0820f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:40.958021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:40.958980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:40.959966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 336/670] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:40.961245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74728-5470-4702-93bc-c300f02bf3e9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:40.961245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74728-5470-4702-93bc-c300f02bf3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:40.961245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc74728-5470-4702-93bc-c300f02bf3e9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:40.966564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 337/671] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:40.966564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc74728-5470-4702-93bc-c300f02bf3e9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:40.987543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383d99e-d89f-491e-9f0b-0660810dd341 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.027863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.028394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.028631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.028907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.029204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.033597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.042922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.044518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:41.059797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:41.060910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:41.067068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:41.067068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:41.067068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:41.067068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 335/672] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:41.067068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.100301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc74728-5470-4702-93bc-c300f02bf3e9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.146470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.147085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.147404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.147670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.148323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.148624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.150012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c60b3-7b49-4bfb-a54f-b915c2745536 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.165698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 338/673] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:41.165698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.165698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.165698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.179513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4e02-d0cc-4a77-bd30-62fd8fff11c1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.183837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:41.185173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:41.217368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.217972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.218297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.218728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.219296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.219593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.221098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.230855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 336/674] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:41.231547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.267653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 339/675] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:41.268531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.311892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.313289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.369110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4b863-8d1a-4239-bffa-f17f2a943b05 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.376231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c016478-78fd-4088-a2d4-bca1113742c7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.406979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.407628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.407901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.408167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.408818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.409127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.410503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.414798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.415618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.415791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.416047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.429986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 337/676] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:41.429986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.434186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.434186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:41.449564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:41.450669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 340/677] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:41.452342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.551662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e86b9-9f20-49a3-871b-35859f01ca84 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.564038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.573010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2e672-bd74-4387-91db-ca598584eb5b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.575568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.594812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.595605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.595882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.596149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.607166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.608684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.617533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.618419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.618903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.619406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:41.624325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:41.625732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:41.626832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:41.626832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:41.626832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:41.630037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 338/678] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:41.630960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.636005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:41.641190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:41.642332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:41.643341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:41.645701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 341/679] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:41.646588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.749619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47701-586d-4451-bc7c-c4e697e8e2ae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.759100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a26aa-4e1f-40ef-9889-e9fa220fa0ca None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.788559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.789591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.790029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.790570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.796859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.797660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.797837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.797991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.798713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.799019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.799896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.800518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.801657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.819229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 342/680] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:41.819505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:41.820512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:41.821617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:41.822245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.822341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 339/681] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:41.822341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:41.847782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.850258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:41.933870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeae96-2c7b-42ef-a0a6-9a8f43785da0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.934140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24a1d-b71e-44e5-9211-5f8b92173c68 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:41.973146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.973764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.974037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.974229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:41.974406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.974833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:41.975039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.975145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:41.975374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.975473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:41.976043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:41.976348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:41.976748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.977729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:41.990878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 340/682] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:41.990878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.092628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.113840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e28af4-4a42-461b-acfa-0dcd4326c178 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.118884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 343/683] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.118884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.150773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.151416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.151694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.152127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.153997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:42.153997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.158495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.169402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 341/684] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.172429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.214478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.240734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f64d7a-cc92-430c-87b2-0ed092668d1e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.280198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.280980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.281436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.281723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.282580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=1daf3ae711f0440ca0b26d214a162074) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:42.282987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.284638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.286962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7fdca-2cc3-4802-a26c-9f9a91ffb60c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.299240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 344/685] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/role_assignments?user.id=1daf3ae711f0440ca0b26d214a162074&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.299240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.341810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.343052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.343424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.343759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.359926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.362388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.366546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:42.386674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:42.387734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:42.388623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:42.388623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:42.388623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:42.388623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 342/686] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:42.389905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.425910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4563219-7d13-4cb6-a466-acfaaabc2083 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.465423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.465423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.465423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.465423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.474893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.476503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:42.489545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:42.490595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:42.491913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 345/687] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:42.495984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.505834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.517743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7588-bd9d-420d-8bff-87f7713a8295 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.564054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.565285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.565849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.566727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.567689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=ec7f568319844b9fbd05f7936d439b56) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:42.568292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.570051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.577273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 343/688] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/role_assignments?user.id=ec7f568319844b9fbd05f7936d439b56&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.578583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.630160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13601d86-8deb-4b11-a0ec-8ff1222fc7ef None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.661779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.685036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.686791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.687089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.687398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.688090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:42.688396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.689817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.708716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 346/689] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.716987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.760831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731e6c-ccd7-4d10-adc2-60c1e47f1b60 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.808051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.808690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.808958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.809223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.810129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:42.810281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.811888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331206-caf3-4d4f-a26f-221c6eaf4936 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.826249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:42.833561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 344/690] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:42.834693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8422f-6adf-47a4-b341-e444b09da65e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.834970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8422f-6adf-47a4-b341-e444b09da65e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.839323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8422f-6adf-47a4-b341-e444b09da65e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.841211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 345/691] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:42.842407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8422f-6adf-47a4-b341-e444b09da65e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:42.867056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef608-593b-4f17-b8ff-cff3a9a1890a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:42.913129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:42.914701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.915513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.916002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.928291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:42.930836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a8ce783c-b068-48c8-b511-a6fd407225d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:42.946798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:42.947961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:42.948879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:42.952089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 347/692] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:42.953777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:42.954247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:42.954640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:42.976357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:42.977667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:42.983249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8422f-6adf-47a4-b341-e444b09da65e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.015063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.046794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.048251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.048871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.049585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.079227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 348/693] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:43.079227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.146786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.148062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.149701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.211670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a6b9-7fa8-4606-a55f-eee6b628374a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.258858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.259781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.260124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.260472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.261427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:43.261806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.264209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.271535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 346/694] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:43.272757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.285651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 349/695] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:43.288233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.298439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.399261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc62cd1-69ce-4d9e-bcf4-31ae86116c13 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.437843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfe6-64e9-403b-b7bc-c0ef1995c12a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.454268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.458330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.459676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.460327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.460636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.461291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.462744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:43.477990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:43.479065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:43.479963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:43.483347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 347/696] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:43.484447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.485295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.485960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.486235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.486507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.498929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.501144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:43.517638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:43.518601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:43.519526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:43.519526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:43.519526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:43.523358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 350/697] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:43.524356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.595834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.620537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfcee1-96ba-4974-a02f-4161f072e13d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.636352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86531678-c3e1-4f07-93b4-be488c9269d4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.671497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.672729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.673265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.673799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.676153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.676839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.677120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.677389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.678172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:43.678481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.679916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.689425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 351/698] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:43.689425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.724881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.768858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.770406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.812601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c114-06c8-47b1-93c7-a5a3867674da None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:43.849147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:43.849842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:43.850084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:43.850285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:43.851033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:43.851365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:43.852749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:43.867315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 352/699] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:43.868246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.878082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.905045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 348/700] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 19:20:43.906278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:43.974931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:43.989794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff52063-b647-466b-a513-64bf7711b756 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.022013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fe34b-ff97-4554-a872-1533beccca5d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.039517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.041041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.041519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.041979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.042815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:44.043342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.045658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.059066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 353/701] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:44.059066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.070501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.071179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.071504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.071774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.087654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.089165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:44.112121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:44.113164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:44.114052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 349/702] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:44.119438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.208367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:44.257470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17791e-1b9f-491c-aaf3-a958ff6849a2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.310130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3c97-fc53-4c52-be54-6a614837ee6e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.311935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.313349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.314654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.314957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.329610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.331943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:44.351911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:44.352915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:44.353825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:44.353825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:44.353825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:44.355648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.356526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.357007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.357459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.358398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:44.358930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.359557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 354/703] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:44.360570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.361031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.373377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:44.375875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 350/704] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:44.381835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.522833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3095b-06f8-4a03-8625-2533b321b0d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.525294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:44.564839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.565796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.566627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.567102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.568332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:44.568859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.570333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6198b5-fdb5-4ef1-abf4-137f8a15fa98 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.570800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cdcfc-987b-4097-bfc1-de62c27ade7f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.579306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 351/705] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:44.581611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c8e4-bf9b-4080-b506-c08c6da0b7c5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.582200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c8e4-bf9b-4080-b506-c08c6da0b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.582702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77c8e4-bf9b-4080-b506-c08c6da0b7c5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.585464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 352/706] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:44.594479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.595529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.596006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.618227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:44.619710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:44.625069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.626131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.626625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.627104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.628048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:44.628598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.631144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.649792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 355/707] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:44.658051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.743379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 353/708] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:44.762263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:44.820621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:44.891610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa6a3-45d8-4cc4-9ed5-b72b52849fd9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.920629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:44.929290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392bc8a-5d3e-47c1-aa1c-01ed93419782 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:44.947530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.948202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.948478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.948746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.961299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:44.962884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2565e49a-c08e-49d7-bfe8-12a360ceb752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:44.977030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:44.977975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:44.978864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:44.979877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:44.979877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.980062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 356/709] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:44.980137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.980137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.980269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025eb2-f68c-4a27-b987-8e48205a87bd None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:44.980269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025eb2-f68c-4a27-b987-8e48205a87bd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:44.980392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4025eb2-f68c-4a27-b987-8e48205a87bd None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:44.985899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 357/710] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:44.986779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4025eb2-f68c-4a27-b987-8e48205a87bd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.001417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.003985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5f016fb2-730b-439c-9fc4-5358f32b4614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:45.032500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:45.035168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:45.037129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:45.037129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:45.037129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:45.043220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 354/711] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:45.043220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.043220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.043220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.062236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:45.063523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:45.115662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4025eb2-f68c-4a27-b987-8e48205a87bd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.140229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 355/712] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:45.141108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.158375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:45.172414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.173054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.173461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.173936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.175318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:45.175856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.178519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.199568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 358/713] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:45.200453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.230050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:45.252603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ab53a-11e1-4fab-bd33-5e475444ad9c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.296541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.297324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.297603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.298180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.298848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:45.299155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.300603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.313490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824806d-31b3-4750-a03e-f41e4bfd31bf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.322161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 356/714] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:45.323138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.353798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.354658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.354939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.355623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.356488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.358426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:45.373067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:45.374328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:45.375170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 359/715] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:45 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:45.376008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.455777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:45.501317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4ee63-038c-4e7d-a58a-7f6cc6aee3f7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.539789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.540428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.540750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.541021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.541692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.543174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.584314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 360/716] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:20:45 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:45.585494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.586415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be78e3-e7d0-44f9-a28e-3876c73f7dc5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.628260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.629370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.629910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.630381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.631459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=d5d8b65b2e324e9c9cbb4e18c715f4da) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:45.632036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.643106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 357/717] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:45 2022] GET /identity/v3/role_assignments?user.id=d5d8b65b2e324e9c9cbb4e18c715f4da&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:45.713120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83950a6-f5d5-4212-89c4-f4b045807fef None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.721695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:45.756872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.757520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.757795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.758048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.758704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] RBAC: Adding query filter params (name=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:45.759001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.760443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1b420-43cb-4174-8baa-ca1bfe9b2d2f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.766103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 361/718] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:45.772637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:45.779707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:45.927565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad874d-a1cd-481d-aec2-964be4e5ae73 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:45.973762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:45.974907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:45.975457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:45.975967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:45.976810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:45.977346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:45.978915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e770609-07a6-4301-9c31-cf1911299248 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:45.985825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 358/719] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:46.571581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636966b-30dd-4cb2-ad2c-ad8e9a6b8f94 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:46.572658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636966b-30dd-4cb2-ad2c-ad8e9a6b8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:46.573148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636966b-30dd-4cb2-ad2c-ad8e9a6b8f94 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:46.575000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 362/720] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:46.584804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ceb06-27ab-439b-9dfa-81a7127c5084 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:46.585918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ceb06-27ab-439b-9dfa-81a7127c5084 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:46.586452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ceb06-27ab-439b-9dfa-81a7127c5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:46.611962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9c9ceb06-27ab-439b-9dfa-81a7127c5084 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:46.613709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9c9ceb06-27ab-439b-9dfa-81a7127c5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:46.694257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:46.709075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 359/721] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:46.730681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636966b-30dd-4cb2-ad2c-ad8e9a6b8f94 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:46.837721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636966b-30dd-4cb2-ad2c-ad8e9a6b8f94 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:46.872784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:46.873446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:46.873722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:46.873989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:46.874640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:46.876041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f20a3-02cf-4ea3-856f-9b39047dd118 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:46.905171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 363/722] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:20:46 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:46.909611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec770e2-d556-4149-9b0a-7108e384311c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:46.909966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec770e2-d556-4149-9b0a-7108e384311c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:46.910161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec770e2-d556-4149-9b0a-7108e384311c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:46.913243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 360/723] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:46.918475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:46.918857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:46.919035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:46.948664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:46.949874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:46.980170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:47.053237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 364/724] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 19:20:47.087457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec770e2-d556-4149-9b0a-7108e384311c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:47.221485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec770e2-d556-4149-9b0a-7108e384311c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:47.256806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:47.257473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:47.257744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:47.258013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:47.279226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:47.288917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:47.289848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:47.290694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:47.295542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 361/725] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:47.301294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:47.432066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb1a3e-bc30-4808-a92f-5e8daebf6305 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:47.489236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:47.489779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:47.490056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:47.490324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:47.490999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:47.491326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:47.492697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:47.505917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 365/726] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:47.512392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:47.571546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:47.628966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36ab6-256d-4b40-9bf1-7efe55ffd79a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:47.664985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:47.665641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:47.665914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:47.666223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:47.676694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:47.678144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:47.693653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:47.694673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:47.695576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:47.695576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:47.695576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:47.699304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 362/727] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:47.701105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:47.727602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:47.834152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf647bac-b0ad-48b9-9076-31b7c1714b08 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:47.879921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:47.880539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:47.880814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:47.881090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:47.881744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:47.882042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:47.883439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:47.901760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 366/728] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:47.907785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.042975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171422-9775-4236-935b-7c9d06f8dcc5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.053413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.089412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.089976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.090249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.090516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.103297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:48.104768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:48.121463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:48.122758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:48.123916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:48.126484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 363/729] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:48.128804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.239091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.270872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee421-90ff-47b4-a631-16ca7b51fea2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.319054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.319702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.319985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.320250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.320994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:48.321293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:48.322723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eb8ef-9ad6-407c-b19f-c7e009afacbe None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:48.345269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 367/730] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:48.352301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.364493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84102-f789-4fd8-b137-e1bf5be0f582 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.365099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84102-f789-4fd8-b137-e1bf5be0f582 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.365562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84102-f789-4fd8-b137-e1bf5be0f582 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.367380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 368/731] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:48.374065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf505fe-20a2-418f-a56b-875f5eb6a630 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.374855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf505fe-20a2-418f-a56b-875f5eb6a630 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.376052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf505fe-20a2-418f-a56b-875f5eb6a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.404477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-caf505fe-20a2-418f-a56b-875f5eb6a630 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:48.406360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-caf505fe-20a2-418f-a56b-875f5eb6a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:48.527045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 369/732] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:48.532223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfac07-415a-45c9-b9af-5282cb7d04b1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.532509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfac07-415a-45c9-b9af-5282cb7d04b1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.532779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfac07-415a-45c9-b9af-5282cb7d04b1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.534107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 370/733] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:48.540173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ec04-1510-4c47-8535-fac6f36c2931 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.543017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7ee1-7dc4-46a4-9bdb-2b5217b57ec9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.543321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7ee1-7dc4-46a4-9bdb-2b5217b57ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.543587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a7ee1-7dc4-46a4-9bdb-2b5217b57ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.574100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-634a7ee1-7dc4-46a4-9bdb-2b5217b57ec9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:48.575358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-634a7ee1-7dc4-46a4-9bdb-2b5217b57ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:48.584485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.585155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.585425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.585892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.597259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:48.598544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:48.612661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:48.613667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:48.614571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:48.614571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:48.614571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:48.614571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 364/734] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:48.614571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.643718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.645136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.653896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 371/735] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:48.655594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a924e-c1e7-411e-9de8-7a14e9246ffa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.655874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a924e-c1e7-411e-9de8-7a14e9246ffa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.656142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a924e-c1e7-411e-9de8-7a14e9246ffa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.657614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 372/736] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:48.658219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a924e-c1e7-411e-9de8-7a14e9246ffa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.752197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218fe49-4252-4f0f-af4f-836338927b96 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.781663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a924e-c1e7-411e-9de8-7a14e9246ffa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.788222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.788867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.789243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.789525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.800101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4a78a7b6-e8ad-42c0-a6e4-234e7385e82f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:48.805281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:48.806259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 365/737] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:48.807858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.808671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.808671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.824660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.825380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.825742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:48.826058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:48.826710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:48.826994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:48.827112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:48.828228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:48.828441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:48.842173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 373/738] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:48.842588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.902962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 366/739] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 19:20:48.903771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:48.912454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.917735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:48.964092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330cc52-613c-4c0a-baab-e6590bd9e6e6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:48.999013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:48.999691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:48.999964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.000230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.011644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695fe03-9e96-45cc-bbfc-f1cfa00dd58b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.012490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:49.017952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:49.018963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:49.020203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 374/740] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:49.020951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.059367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.060412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.061004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.061376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.062182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:49.062489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.063891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.072705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 367/741] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:49.073577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.135123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397ff4-2d4a-41cc-8d52-c1e3fa9af345 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.146990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.154407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.174380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.175031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.175345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.175618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.183280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06301e36-0ba6-47ff-a2be-198349a62f58 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.183822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.185307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:49.197800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:49.198903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 375/742] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:49.200649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.225302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.226138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.226404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.226677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.227375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.228743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.247443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 368/743] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:20:49 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:49.248436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.340992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8034-e17c-4200-9dba-d924da524fc3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.399020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.399020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.399020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.399020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.399844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:49.400150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.401532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.415445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc4b8-0bf2-49ba-9011-1434c5ab3071 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.416306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 376/744] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:49.417240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.463677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.464819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.475614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.476277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.476556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.476825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.488756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.490226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:49.505177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:49.506193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:49.507085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:49.507085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:49.507085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:49.507085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 369/745] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:49.507394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.546609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492f35-546d-4aa6-bd4a-da3b1561da95 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.587240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.588345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.588770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.590063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.590992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:49.591528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.593197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.608220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 377/746] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:49.608779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.626952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c55-5816-4868-99df-f7a0dffe08c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.663630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.664332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.664533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.664802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.676341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.677810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e30cc29b-aa1e-4b29-b99e-4f189f0dff36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:49.693324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:49.694313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:49.695252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:49.695252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:49.695252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:49.695252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 370/747] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:49.695788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068fdd-620d-4aec-9ef4-411835a86fee None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.695879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068fdd-620d-4aec-9ef4-411835a86fee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.696149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068fdd-620d-4aec-9ef4-411835a86fee None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.697632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 371/748] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:49.698318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068fdd-620d-4aec-9ef4-411835a86fee None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.724103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.732915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2aa2-a089-438a-93ac-29c8930c3a69 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.742063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:49.771662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.772280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.772558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.772829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.773488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:49.773790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.775174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.792130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 378/749] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:49.792130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.818858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068fdd-620d-4aec-9ef4-411835a86fee None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.855582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.856254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.856528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.856796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.858744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=31fcd522972b4af7ab786a11af6938f6, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.860212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e093-d171-41a2-9b6f-a745bdff3a3b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.875015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 372/750] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:49 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:49.876364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.876646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.876914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.896771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:49.898443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:49.927075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11661a5-9786-40cf-9b7f-67de278f84da None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:49.976890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:49.977536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:49.977810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:49.978085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:49.978753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:49.979055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:49.981420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:49.989792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 373/751] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:49.991037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:49.998212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 379/752] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:50.004190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.027632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.028090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.119797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788751-2587-4970-b52f-9e1a5885e2ef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.138883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb4fb8-98f4-4b57-89cf-3078fc46c104 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.158974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.160084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.160780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.161405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.170300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.172226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.176188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.176846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.177179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.177460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.185630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.187121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:50.187404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:50.188306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:20:50.189228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:50.192347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 374/753] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:20:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:50.193562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:50.203470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:50.204476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:50.205766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 380/754] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:50.206381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.290114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.300432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.309099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308f84-0d8c-4af3-93f0-38af5d751e7c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.329748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f68c-dd68-4573-b5a0-455f22564b05 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.345696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.346696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.347176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.347710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.348513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.350099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:50.359690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:50.360754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:50.361589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:50.369447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 375/755] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:50.369447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.371748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.372376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.372650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.372919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.373884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:50.374370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.376311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.401627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:50.403159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.511627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cea3c5-5503-451a-93b8-d692991c69c4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.529261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e56d2-7c89-4dcb-ae76-e099a0049010 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.555593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.557024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.557806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.558280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.559737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:50.560518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.562618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.564540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.565233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.565512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.565779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.566781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:50.567078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.568483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.578047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.578047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 382/757] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:50.578047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.592961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 376/758] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:50.594171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.608747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.712516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f5c-156c-4a8e-82d2-b926a26d6ff5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.731513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200281c-003a-4f3f-b326-3095de661a8a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.760754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.761532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.761909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.762276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.777830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.779081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.779535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.780193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:50.781013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:50.781635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.783530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.794945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 377/759] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:50.794945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.838233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:50.839902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:50.843563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.886106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:50.925021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc5c4-4a54-4590-8bbc-a5c2a2e84701 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:50.969997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 383/760] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:50.969997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:50.975239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:50.975974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:50.976345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:50.976772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.057295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.058995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.107618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.116209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4cea-daf8-4376-817a-054cee6ee1f0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.138209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.164383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.165576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.166004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.166681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.167985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] RBAC: Adding query filter params (interface=public, service_id=546c0832f68f44eeb343a8c25bbb086c, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:51.168715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.170585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.179641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 378/761] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:51.184118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.184528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 384/762] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:20:50 2022] GET /identity/v3/endpoints?service_id=546c0832f68f44eeb343a8c25bbb086c&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:51.186627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.303756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a393b-b7a2-41e3-92b7-4b82d867c0d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.308249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e150-de17-4347-be7b-a0263a8282e9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.342466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.343464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.343899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.344268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.354298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.355490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.355918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.356056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.356458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.357727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.370498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.372227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:51.374580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:51.375766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:51.376904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:51.376904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:51.376904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:51.382623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 379/763] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:51.382623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:51.396963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:51.398242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:51.399468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:51.399468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:51.399468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:51.405449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 385/764] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:51.406546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.416620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.424401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.508598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8915947-fbdc-470a-bb98-093439d8b9f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.521215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0ff8-610f-40ac-a2ec-b3b160437ea2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.547664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.548397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.548686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.549052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.549683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.551054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.557360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.557536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 380/765] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:51.567540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.567540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.567852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.567962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.567962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:51.567962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.567962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ac50a-a8fb-4db3-8fb3-fa4825758f24 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.581869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 386/766] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:51.583504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800578f-6171-4f87-a1aa-c0dfb75a8d03 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.583895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800578f-6171-4f87-a1aa-c0dfb75a8d03 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.584265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800578f-6171-4f87-a1aa-c0dfb75a8d03 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.590569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 387/767] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:51.591712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800578f-6171-4f87-a1aa-c0dfb75a8d03 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.680040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.692239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.696724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9757-3f44-4b8c-83e3-6a0281077080 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.737650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800578f-6171-4f87-a1aa-c0dfb75a8d03 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.737869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.738560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.738935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.739389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.740138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:51.740511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.742008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3d2b-7fda-4f72-acff-918fcf83504a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.756443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 381/768] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:51.757995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.758360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.758722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.779607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:51.780826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:51.787848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.788502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.788776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.789042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:51.799390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:51.800866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:51.818258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:51.819322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 388/769] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:51.820895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.875218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 382/770] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:51.875218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:51.954853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951040-0092-4bf7-b931-91955e800d23 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:51.981817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.990931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:51.996666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:51.997315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:51.997597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:51.997868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.005117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.006582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.009481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbdb16-2c59-4f48-b8f9-7a8e0295da7b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:52.018134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:52.022983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 389/771] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:52.024237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.056234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.056856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.057142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.057411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.058107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.058412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.059887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932220-28dd-41c4-81a0-cd7c0121eeda None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.072299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 383/772] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.073562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d41e3-9e5c-4021-aa86-41845c12dc8c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.073852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d41e3-9e5c-4021-aa86-41845c12dc8c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.074125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d41e3-9e5c-4021-aa86-41845c12dc8c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.075514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 384/773] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:52.076113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d41e3-9e5c-4021-aa86-41845c12dc8c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.151993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061990f-f5b1-404a-aefb-a2dc9f34299b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.189577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.190221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.190494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.190759 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] PATH_INFO: `/v3/services/network` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.191722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.192160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d41e3-9e5c-4021-aa86-41845c12dc8c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.193089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:52.203395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:52.204499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:52.205696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 390/774] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:52.206510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.238454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.239400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.239655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.240017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.240822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.241222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.242756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3e8f-1148-4cc5-9a82-0965ffc0abdb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.250727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:52.261999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 385/775] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.263527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.263915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.264320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.267927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:52.283825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:52.285706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:52.314993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166d5b-0df8-4cc4-9a8a-5fb1c8dfba73 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.353382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.354031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.354311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.354582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.355356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=35c6943e3d5a443eb84b719e0bb60885) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.355673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.357112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.363043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 391/776] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/role_assignments?user.id=35c6943e3d5a443eb84b719e0bb60885&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.363957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.379626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 386/777] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:52.387816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.514437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e88b-be94-46ab-8efe-2774cd4d5102 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.520808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce9c1-5c80-4e84-a5e2-344667b41c3f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.548102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:52.550366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:52.560099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.561298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.561732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.562140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.563923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=d5d8b65b2e324e9c9cbb4e18c715f4da) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.564382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.566128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.570657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.571717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.572094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.572462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.573803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 387/778] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/role_assignments?user.id=d5d8b65b2e324e9c9cbb4e18c715f4da&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.574205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] RBAC: Adding query filter params (name=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.574606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.579221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.579402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.584189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 392/779] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.590899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.767695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8915-0569-40da-bcc0-18ba77691499 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.771913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234dc4-6b57-46a6-b0cd-10e48f5f1c37 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:52.815220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.815953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.818224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.818590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.838236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:52.838856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:52.839131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:52.839434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:52.840084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] RBAC: Adding query filter params (type=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:52.840386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:52.841778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:52.847943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 393/780] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:52.848538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:52.855327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:52.856290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:52.857121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:52.859686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 388/781] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:52.861358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.868253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:52.935346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:52.982099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f311114-6c62-4aa9-835e-6d6da4d41452 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.017947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.018597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.019169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:53.020156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.020560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.021413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] RBAC: Adding query filter params (interface=public, service_id=df455cd16d4247f2977c4fa3077b46c5, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:53.022556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.024089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.030424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 394/782] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/endpoints?service_id=df455cd16d4247f2977c4fa3077b46c5&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:53.046612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:53.082314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f325-4553-4d10-87ee-be299010fac4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.137221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.137873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.138156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.138421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.139225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:53.139537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.140931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.159288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 389/783] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:53.164421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:53.228379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b2706-9858-449a-9ac6-0307a47f295b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.256516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:53.299495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530eb44-0510-469f-a70b-25afd44342d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.314977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.315818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:53.316814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.317241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.317671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.318454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.320011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.335143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 395/784] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:20:53 2022] GET /identity/v3/services => generated 772 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:53.344322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.345089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.345449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.345789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.374629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.376257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:53.404176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:53.405354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:53.410866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:53.410866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:53.410866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:53.412477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 390/785] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:53.417168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:53.593880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b59804-bc36-45d2-9972-243c1939ca15 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.629702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.630332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.630612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.630882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.631574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:53.631878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.633270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.646659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 396/786] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:53.651796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:53.781946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f14f9-ca08-4cdf-96e2-a9332f9f4606 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:53.830447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:53.831128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.831433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.831702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.841739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:53.843270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-822cfe09-f564-4661-bd43-bb2faf0e798a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:53.859257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:53.860254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:20:53.861205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:53.864752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 391/787] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:20:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:53.866019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:53.892530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6cfa-ed3c-4cfc-8723-ae3897861ad1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.892889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6cfa-ed3c-4cfc-8723-ae3897861ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.893077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6cfa-ed3c-4cfc-8723-ae3897861ad1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.894544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 392/788] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:20:53.899939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:53.900527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:53.901017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:53.915605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:53.928817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:53.930445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:53.957507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.028805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 393/789] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:20:54.062098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22806d-afb8-4b97-9df7-5b3a2bdf2486 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.076944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.122941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.124880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.125622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.126112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.131374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:54.131930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.133688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.153153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 397/790] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:20:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:54.159163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.275370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d880-fe14-4153-a2bf-25174b357e3a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.331580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.337677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af72ef3-ed9c-47ec-a806-5c59a234a076 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.361518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.362316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.362654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.362926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.363553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.364932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:54.384802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:54.385865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:54.386690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 394/791] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:54.394078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.418480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.419135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.419852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.420124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.447587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.506728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.508266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.602548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1eb5b-031c-422d-bf42-5b35463834ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.693447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 398/792] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:20:54.693843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.695429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.696103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.696379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.696645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.697581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:54.698006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.699176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.703914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa638997-d005-4968-9c25-7e9c70b74296 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.710229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 395/793] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:54.716116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995114ca-e6e5-467b-bb88-01e19d618261 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.716399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995114ca-e6e5-467b-bb88-01e19d618261 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.716667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995114ca-e6e5-467b-bb88-01e19d618261 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.718402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 396/794] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:54.719166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995114ca-e6e5-467b-bb88-01e19d618261 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.817098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045376-8450-419d-83ef-724c930d6fdf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.833760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.853727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.854397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.854683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.854959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.855739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995114ca-e6e5-467b-bb88-01e19d618261 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:54.866746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.867970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fd22a09a-235b-44d2-bce1-7fb62b6bff9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:54.884700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:54.886466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 399/795] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.888292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.904979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:54.905954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:54.906403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:54.906871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:54.907837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:54.908312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:54.908729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:54.909947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:54.910299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:54.921235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 397/796] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:54.922493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:54.956361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:54.984055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 400/797] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:54.987398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.046556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c4-e5ee-4f2e-9b48-d584e5942979 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.083231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.083865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.084144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.084417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.085071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:55.085371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.086744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50871ea-6fb0-4b22-bbb5-614d4f02cac0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.099296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 398/798] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:55.100337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cf9a-6f74-4e3b-a5cf-e2599d882548 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.100621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cf9a-6f74-4e3b-a5cf-e2599d882548 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.100883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70cf9a-6f74-4e3b-a5cf-e2599d882548 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.102197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 399/799] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:55.102738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70cf9a-6f74-4e3b-a5cf-e2599d882548 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.110204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe43e6-d937-46ce-af6b-d1584aa53524 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.116368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.147670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.148302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.148582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.148850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.149523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.150918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.176950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 401/800] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:20:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:55.177917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.228537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.272645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70cf9a-6f74-4e3b-a5cf-e2599d882548 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.313439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.314352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.314466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.314758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.328007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ac8c4a2b-a2be-43d1-bbdb-f9cb16589c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:55.334508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:55.335577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:55.336440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 400/801] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:55.337672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.337672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.337996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.340166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623eff3-72f5-4d2b-beb6-6c09a4dda8ce None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.358314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:55.359570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:55.389683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.390417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.390687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.390884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.401315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.402792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:55.415464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:55.416450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:55.417344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 402/802] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:55.418263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.437603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.447093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 401/803] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:55.448263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.557623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7338430-18b0-4b37-91bd-c21f5e5b4b0a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.560948 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.568827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779b667-3ca4-4df8-8094-3e47cf9aa71a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.593843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.594736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.595219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.595960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.596896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:55.597346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.598984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.615228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 403/804] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:55.615228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.615488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.615488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.615488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.615488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.615780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:55.615780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.615780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.629415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 402/805] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:55.635176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.694044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.725737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd47aa-118c-495f-94b8-7cbc25a75d5d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.741280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5db52-91fe-4728-9239-cc3ade8ea670 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.764242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.765305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.765857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.766420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.777188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.777832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.778106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.778373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.779834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:20:55.785139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:55.786089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:20:55.786932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:55.788159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 404/806] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:55.788938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.790657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.792155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.808384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-feedd193-fa4f-4ec6-9e55-1928541dc503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:55.810661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:55.811712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:55.812603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:55.812603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:55.812603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:55.812603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 403/807] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:55.814235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337bdc-9583-4cc1-af38-a3d2bb383898 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.814581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337bdc-9583-4cc1-af38-a3d2bb383898 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.815015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a337bdc-9583-4cc1-af38-a3d2bb383898 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.817692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 404/808] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:55.819265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a337bdc-9583-4cc1-af38-a3d2bb383898 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.901338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d127-55c2-489d-9890-80fbe7250ec2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.948239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:55.949189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:55.949673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:55.950154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:55.951618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:55.952148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:55.954876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:55.964818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a337bdc-9583-4cc1-af38-a3d2bb383898 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:55.975418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 405/809] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:55.975418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:55.983122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.022562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.023522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.023927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.024324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.025267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:56.025690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.028074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713ca9-c06f-4bf2-aa82-f15b4ded6e5e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.044032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 405/810] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:56.045908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.046264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.046656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.069160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:56.070417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:56.079507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.107942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d698-5181-4c0b-88fb-6747a0860ab6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.155231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.155905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.155988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.156218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.156865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:56.157201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.158285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 406/811] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:56.163343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.163508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.173976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 406/812] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:56.179841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.275432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.283764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d5a1-bcab-48bf-ba8d-b7f1e36f9521 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.310040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb86088-d64a-47fa-ad07-84d3ba763984 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.320195 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.320759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.321037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.321293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.332386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.333562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:56.348723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:56.349772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:56.350717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:56.350717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:56.350717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:56.350717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 407/813] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:56.351411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.361092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.361770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.362045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.362325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.378386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.380585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.383786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:56.400625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:56.401662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:20:56.402616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:56.409724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 407/814] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:56.409724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.483334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e40e-9350-412b-8303-7342712c75eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.526054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.526937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.527345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.527713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.528412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.530038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:56.539726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:56.540971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 19:20:56.542016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:56.548918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 408/815] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:56.548918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.553370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986411f6-672a-454d-b46a-2cba1ef2f733 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.570492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.593911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.594696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.595075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.595484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.596349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:56.596772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.598403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.612918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 408/816] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:56.614091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.683049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.685054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f652-690c-4809-b6ab-ad11bdd2d000 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.730774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.731458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49047825-d96f-45ca-8c79-da2e914dd7bd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.731872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.732285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.732810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.733969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:56.734413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.736700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.765794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 409/817] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:56.765794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.779018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.780133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.780247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.780448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.781178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] RBAC: Adding query filter params (name=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:56.781490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.783034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.793450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 409/818] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:56.794504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.849109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.884340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b953f20-c742-4b3a-b9e5-000ee0e5b3a6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.908917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195f00-121f-4766-9f52-cc02eafd303f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:56.934946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:56.939783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.941061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.941909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.942366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.950008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:56.950963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:56.951614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:56.952077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:56.956556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.959408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.963995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:56.965728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:56.981465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:56.982476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:56.983534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:56.983534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:56.983534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:20:56.983704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:56.984959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:56.985896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 410/819] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:56.986468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:56.993290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 410/820] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:56.994598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.100944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdf6e-56aa-4f74-a41d-e6d931460785 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.136918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.137951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.138421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.138909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.140118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:57.140623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.142259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.161934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 411/821] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:57.163636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.172556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6e76-067e-4d89-8389-ee29d550fce8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.198640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.228978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.236299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.236877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.237205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.237484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.238193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:57.238507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.239934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.250592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 411/822] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:20:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:57.251707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.283096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dbe42-0d05-46db-9bfe-53a5ef9d5b03 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.323023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.323524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.323807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.324066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.324715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:57.325011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.326447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.343385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 412/823] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:57.343385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.376324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30abf-4ded-442f-98ae-5b645b5ae11d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.413208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.413856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.414127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.414392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.429948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.429948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8391135a-9da8-40d4-a810-740d22423278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:20:57.444377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:57.445676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:20:57.446574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:20:57.446574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:20:57.446574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:57.446574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 412/824] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:57.446801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b54a8-39ba-4855-a1d0-0097468fa72a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.447516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b54a8-39ba-4855-a1d0-0097468fa72a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.447516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b54a8-39ba-4855-a1d0-0097468fa72a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.451717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 413/825] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:57.451717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b54a8-39ba-4855-a1d0-0097468fa72a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.467152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.477401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca95cc-52d0-42f5-92d6-07be80e354d4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.515109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.517402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.518037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.518558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.518558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.519227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.521465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.551228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 413/826] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:20:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:20:57.551228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.605744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b54a8-39ba-4855-a1d0-0097468fa72a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.647530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.648276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.648621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.648948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.657673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.659524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b6334c54-b277-447d-9c93-e47096a69605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:57.673086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:57.674262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:57.675413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:57.681077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 414/827] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:57.682712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.682994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.683290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.704485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:57.705899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:57.731100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19fe8-4278-47cf-832e-0bf694668d81 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.768551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.769182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.769455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.769722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.770370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:57.770681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.774062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.786505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 415/828] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:57.787738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.788039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 414/829] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:57.793754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:57.811741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.841735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:57.927072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f569-dd21-44e4-8026-919d0ecd80d6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.956588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94563d05-ca4a-4c4c-a469-f8f96e797b73 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:57.968903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:57.969797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:57.970218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:57.970680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:57.972211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:57.972522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:57.973994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:57.987769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 416/830] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:57.988636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.017352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.019172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.019723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.020425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.032165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.033720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:20:58.047043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:58.048498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 415/831] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:20:58.049406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.106334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.113557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4b6a-ba20-46f0-92f6-cda13ce317d4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.126915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.149631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.150287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.150560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.150825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.151456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.152842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:58.162100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:58.163410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:20:58.164272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 417/832] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:58.165099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.171885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab192-0687-4816-91ac-810e7f2953ec None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.211660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.212351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.212627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.212892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/35c6943e3d5a443eb84b719e0bb60885/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.229662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=35c6943e3d5a443eb84b719e0bb60885, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.231209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf7cc5-a40d-405d-b9fa-9c2c2b3009d3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.245260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 416/833] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:58 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/35c6943e3d5a443eb84b719e0bb60885/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:58.246546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dea3d-1734-4f45-b0c7-d7fb1b3a69d5 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.246805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dea3d-1734-4f45-b0c7-d7fb1b3a69d5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.247067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dea3d-1734-4f45-b0c7-d7fb1b3a69d5 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.248414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 417/834] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:20:58.249137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dea3d-1734-4f45-b0c7-d7fb1b3a69d5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.291850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd91ce-af31-4adb-8803-79f1afae8549 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.356144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.357181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.357688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.358204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.359525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:58.360063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.362809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c371a-d2a7-42a0-9c51-2ab6dad43d87 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.379635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dea3d-1734-4f45-b0c7-d7fb1b3a69d5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.393416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 418/835] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:20:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:58.396541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.397062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.397609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.400542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.426668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:20:58.428931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:20:58.430755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.431986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.431986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.431986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.432615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:58.432904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.434284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.439978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 418/836] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:58.440793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.452242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.535769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 419/837] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:20:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:20:58.535769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.562353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571ceb-b214-4c18-9b30-59bd6430c097 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.599290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.600127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.600502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.600874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/d5d8b65b2e324e9c9cbb4e18c715f4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.602925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=d5d8b65b2e324e9c9cbb4e18c715f4da, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.604505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.627232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 419/838] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:20:58 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/d5d8b65b2e324e9c9cbb4e18c715f4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:20:58.627232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.685862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.694406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27dee-54ef-4f91-a18f-c03d6c830402 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.741821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.742572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.742944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.743314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.744064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:58.744548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.746133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.752372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 420/839] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:20:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:58.773884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5c037-77d1-4a5f-8635-d2e9fbf1bd84 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:58.817522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:58.818247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:58.818595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:58.818934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:58.819658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:58.821272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:20:58.831612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:20:58.832827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:20:58.833941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:20:58.835289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 420/840] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 19:20:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:20:58.844586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:58.864724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:58.974275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282ff1-f8f6-4ad5-9cd9-4e050e12a802 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:59.010375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:59.011760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:59.012176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:59.012605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:59.013396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:59.013835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:59.015588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ea4a6-c02c-4512-a8a8-64ce03aa88ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:59.021495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 421/841] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:20:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:20:59.026934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:20:59.138602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efe8e4-f06b-4cdb-9ab1-c4cc377b7e5e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:20:59.146134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:20:59.176965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:20:59.177773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:20:59.177953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:20:59.178224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:20:59.178872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:20:59.179173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:20:59.180596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d6a0-f488-4ded-891f-b2952b171552 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:20:59.186026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 421/842] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:20:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:00.273385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf77ff-2212-4754-8283-52d30e5fa14c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.273930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf77ff-2212-4754-8283-52d30e5fa14c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.273930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf77ff-2212-4754-8283-52d30e5fa14c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.275425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 422/843] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:00.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.282098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.282570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.302291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:00.303972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:00.383023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 422/844] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:00.406888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf77ff-2212-4754-8283-52d30e5fa14c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:00.509071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:00.538197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf77ff-2212-4754-8283-52d30e5fa14c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:00.576810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:00.577877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.578356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.578820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.590734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:00.595853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:00.596832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:21:00.597734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:00.600496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 423/845] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:00.606438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:00.718660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:00.721721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03221e6e-a8fd-4511-b804-7ad2684db80d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:00.760444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:00.761079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.761352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.761620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.762300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:00.762602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:00.764091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0579-134e-489e-888e-8474ebbbfa17 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:00.773379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 423/846] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:00.778622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:00.864148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb692a-cd29-4274-9114-a528f8d94bd4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.864804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb692a-cd29-4274-9114-a528f8d94bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.865364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb692a-cd29-4274-9114-a528f8d94bd4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.868184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 424/847] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:00.878230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800a7-4805-421e-800d-14efc4da631c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.878764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800a7-4805-421e-800d-14efc4da631c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.879181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800a7-4805-421e-800d-14efc4da631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.898695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-adf800a7-4805-421e-800d-14efc4da631c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:00.900426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-adf800a7-4805-421e-800d-14efc4da631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:00.900981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2aeda-d161-4d7c-b74f-6cc3de86a6ee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:00.942343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:00.943014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.943327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.943598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.946837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:00.957065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:00.958569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a38f0846-5786-456f-b162-a288f86c140f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:00.975185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:00.976265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:00.977165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:00.977165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:00.977165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:00.978058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 424/848] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:00.979925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129efff-35c5-4e1c-8fd0-2515f2920af9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.980198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129efff-35c5-4e1c-8fd0-2515f2920af9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.981161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129efff-35c5-4e1c-8fd0-2515f2920af9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:00.982112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 425/849] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:00.984039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129efff-35c5-4e1c-8fd0-2515f2920af9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:00.991992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 425/850] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:00.993264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:00.993669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:00.993841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.028709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:01.030540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:01.135412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 426/851] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:01.135412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.148956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129efff-35c5-4e1c-8fd0-2515f2920af9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.164739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.208970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.209935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.210382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.210818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.211708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:01.212197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.214463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.238157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 426/852] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:01.238157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.277495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e2b4c-25b7-41e8-a390-79ff9ef9c7bf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.288955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.313223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.314167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.314580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.314981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.331746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:01.338761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:01.339945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:01.340799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 427/853] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:01.341504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.343973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e0af-a0bb-48c9-9eef-459736b1341d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.379443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.380067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.380339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.380610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.381265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.382641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9c20-5a74-4e99-9493-256f039cb304 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.397613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 427/854] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:01 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:01.399114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef345-2180-4c10-a3e3-87785e266da9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.399455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef345-2180-4c10-a3e3-87785e266da9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.399726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef345-2180-4c10-a3e3-87785e266da9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.401165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 428/855] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:01.406291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef345-2180-4c10-a3e3-87785e266da9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.455016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.477494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acef59-ffa5-40cb-aae3-c09039db112a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.525686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.526356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.526635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.526903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.535701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.537345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.547291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef345-2180-4c10-a3e3-87785e266da9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-295e1d52-a8db-49fe-a8c2-f557c9566383 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:01.550524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:01.551534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:01.552508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:01.556642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 428/856] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:01.558140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.558430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.558701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.561101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.582463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:01.583742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:01.595884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.596507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.596787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.597058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.597747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:01.598049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.599481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.609118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 429/857] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:01.609909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.664115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 429/858] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:01.665427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.723554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84c713-c5e2-4337-9540-f1e3b1759d42 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.746117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.765095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3698883-f648-44f1-adff-330587beabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.765718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3698883-f648-44f1-adff-330587beabfd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.765997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3698883-f648-44f1-adff-330587beabfd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.766269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3698883-f648-44f1-adff-330587beabfd None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.767066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3698883-f648-44f1-adff-330587beabfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:01.767502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3698883-f648-44f1-adff-330587beabfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.769332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3698883-f648-44f1-adff-330587beabfd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.782594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf754d4-f2b6-4c6e-80b0-4a73aa71ee86 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.794376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 430/859] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:01.794376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3698883-f648-44f1-adff-330587beabfd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.825989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:01.831271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.831926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.832202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.832467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.844703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.846184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:01.862440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:01.863562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:01.864473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:01.864473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:01.864473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:01.864473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 430/860] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:01.864473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.912753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3698883-f648-44f1-adff-330587beabfd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:01.948240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:01.948862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:01.949137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:01.949404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:01.950052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:01.951694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:01.967585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 431/861] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:01 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:01.968905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:01.996568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc7d4-7ae1-4adc-aea4-693c14d9d4af None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.028918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.061315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.062373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.063283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.063794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.087404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.105106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee6ff-67e1-447c-98d9-031e5cdd248a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.143939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.144558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.144832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.145098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.145750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:02.146045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.147441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.163390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 432/862] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:02.167098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.167332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.168757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.293911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 431/863] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:01 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:02.299717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.301209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd037-8873-4817-b8c9-2efeeebd45a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.322774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.349433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.350237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.350607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.350967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.358901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.360688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:02.373461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:02.374517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 19:21:02.375513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:02.379331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 433/864] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:02.381035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.392565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.421643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b389451-3421-48f3-978e-bc7f16565195 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.460655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.461674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.462147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.462610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.474246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.476132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:02.491977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:02.493077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:02.494028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:02.494028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:02.494028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:02.496323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 432/865] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:02.498964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe3a5d-bd5b-46ae-8094-32a4745a6567 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.503249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.537602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.538481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.538903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.539460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.540336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:02.540776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.542335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.565877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 434/866] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:02.568056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.581370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.618693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e9caa-da01-4a69-baf9-cc218c078d09 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.654086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.655142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.655551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.655887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.655990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.656613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:02.657056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.658730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.677210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 433/867] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:02.678242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.698421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b4cd-3d1a-4c81-b6a1-bc74d50694eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.732907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.733625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.733962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.734565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.806297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54375d9-7687-4203-97d5-cb65ba07fe68 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:02.818280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.820184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.841428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.852258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:02.853718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:02.854198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:02.854640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:02.868763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:02.871043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:02.886197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:02.887139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:02.888074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:02.889355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 434/868] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:02.894193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:02.904705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:02.950839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 435/869] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:02.956444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.035498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203b930-35c5-4c3b-b363-4b8e119f0b6e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.077043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e381341-a9d2-469d-946d-86af3814a36f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.118437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.118919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.119509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.119783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.120051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.121164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.122283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.123824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.125349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:03.126165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.130621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.132240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.133763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:03.150943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:03.152549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:03.153440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:03.153440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:03.153440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:03.157734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 436/870] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:03.157892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 435/871] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:03.158675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.163916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.187934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.233929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.299442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145aed-02b3-4f36-a64c-712f854b6f83 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.300749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353504ff-6edb-4759-9b7c-556e43afbc1d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.344990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.346019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.346019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.346019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.346737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=35c6943e3d5a443eb84b719e0bb60885) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:03.347040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.348979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.355859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.358020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.358779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.359518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.361777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:03.363182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.363679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 436/872] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/role_assignments?user.id=35c6943e3d5a443eb84b719e0bb60885&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:03.366117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133b0d6-a7dd-4ca5-8386-55d5db3c132b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.391458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 437/873] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:03.400003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.519622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1fcf1-85fc-4e9b-b6c8-aee4d8f4b7ea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.534795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce105-345d-4ef4-8f3f-5894059aa2f6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.535144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce105-345d-4ef4-8f3f-5894059aa2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.535445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce105-345d-4ef4-8f3f-5894059aa2f6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.536994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 438/874] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:03.539964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.543295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.543881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.544356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.567857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.568284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:03.568523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.568783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.569261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.569359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:03.581013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.583164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:03.599692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:03.600603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:03.601851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 437/875] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:03.607184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.676780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 439/876] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:03.699475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.720923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.742788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8405cb-d252-460d-bca4-5e61904c94e7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.792003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.792965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.793706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.794188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.795940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:03.796725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.798686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.812802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 438/877] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:03.819237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.835294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7ce56-99dd-45f8-ad16-5089ecb85b90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.863713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:03.876136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:03.877071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:03.877516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:03.878040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:03.878852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:03.880574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:03.890592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:03.891918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:03.892773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:03.895058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 440/878] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:03.900727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:03.953178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2f4ab-5a5a-459d-8c1c-3a0c5a42004e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:03.995098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.000372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.001262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.001572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.002497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.003315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=d5d8b65b2e324e9c9cbb4e18c715f4da) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.003626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.005196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.012428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 439/879] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/role_assignments?user.id=d5d8b65b2e324e9c9cbb4e18c715f4da&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:04.038801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358b1d-b0ab-48ad-a206-810d51c5cbc6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.078556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.079223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.079502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.079778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.080442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.080743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.082184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d219-0be2-45f9-87a2-a2a8e75a939d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.088372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 441/880] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:04.094254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.116817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebef3-d8a4-4126-a4d2-0613a9e553b0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.117004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebef3-d8a4-4126-a4d2-0613a9e553b0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.117254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebef3-d8a4-4126-a4d2-0613a9e553b0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.118685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 442/881] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:04.124600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13136845-781c-4301-b85e-72aef6a67943 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.124925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13136845-781c-4301-b85e-72aef6a67943 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.125174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13136845-781c-4301-b85e-72aef6a67943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.144815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-13136845-781c-4301-b85e-72aef6a67943 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:04.146189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-13136845-781c-4301-b85e-72aef6a67943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:04.232786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 443/882] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:04.233442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.239330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653061d7-d501-43d1-85ca-cb95e275d101 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.255696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13136845-781c-4301-b85e-72aef6a67943 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.281469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.282525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.283015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.284094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.285233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.285746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.287698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.296970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 440/883] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:04.304352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.337755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.378320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13136845-781c-4301-b85e-72aef6a67943 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.416369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.417027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.417298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.417613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.418217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.422653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:04.433580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:04.434622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:04.435577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:04.438429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 444/884] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:04.445898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.448171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d798-cfd8-4c2c-abef-700fb499e224 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.499739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.500514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.500813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.501592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.502376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] RBAC: Adding query filter params (interface=public, service_id=dffdabb68c7d4fbaa66f857b20cf8374, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.502686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.504532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.512803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 441/885] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/endpoints?service_id=dffdabb68c7d4fbaa66f857b20cf8374&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:04.519767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.553692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.577737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0d89-2ad0-4c20-ba3b-357d8991acaa None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.611767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.619753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.620626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.621068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.621471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.622280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.622723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.624378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.630189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 445/886] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:04.635555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.642760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43c4c-8f8a-4017-99c6-d4ebd1de3b82 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.684158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.685095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.685379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.685652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.686368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.688834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.699270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 442/887] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:21:04.766315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b30c2-8d8a-4a65-9a5a-6aa0964f7ec6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.804831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.805458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.805730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.805993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.806689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.806995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.808460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.814607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 446/888] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:04.821229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:04.915216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:04.927882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066206aa-c5a8-4ac6-a0cc-52da5a0af42f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:04.963881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:04.964495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:04.964767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:04.965031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:04.965746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] RBAC: Adding query filter params (interface=public, service_id=01d28aaf90b84e3292ede08ff613cf2a, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:04.966048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:04.967476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb0fa-a38f-4d07-8784-fe133b51053f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:04.977345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 443/889] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/endpoints?service_id=01d28aaf90b84e3292ede08ff613cf2a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:04.978792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:05.041633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:05.092591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421c79-9397-469c-9a6a-657e0f4f2fdd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:05.126947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:05.127591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:05.127861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:05.128125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:05.128739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:05.130097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c542-465f-4102-a28c-d07fc8c4ba32 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:05.136491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 447/890] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:04 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:21:05.622145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d00a-3ed4-459e-bd7b-302041893908 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:05.622783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d00a-3ed4-459e-bd7b-302041893908 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:05.622783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d00a-3ed4-459e-bd7b-302041893908 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:05.624353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 444/891] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:05.629648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:05.630194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:05.630194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:05.653523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:05.654787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:05.723851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 448/892] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:05.746828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d00a-3ed4-459e-bd7b-302041893908 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:05.853643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d00a-3ed4-459e-bd7b-302041893908 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:05.890656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:05.891329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:05.891604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:05.891870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:05.902484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:05.907443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:05.908498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:05.909417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 445/893] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:05.914984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:05.969182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.017563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879212-766e-4bd7-9de4-c61e1f364d36 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.053273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.053891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.054161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.054431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.055103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:06.055476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.056851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c096a-db12-4f87-b68e-51e0d2ec8ac5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.065930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 449/894] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:06.072062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.090975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.176300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cbbe-9d30-497b-94eb-7bdb5de91d57 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.176670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cbbe-9d30-497b-94eb-7bdb5de91d57 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.176883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cbbe-9d30-497b-94eb-7bdb5de91d57 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.178548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 450/895] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:06.184283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.184592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.184705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e3054-6a25-4253-bb7b-9c039b2742b4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.184870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.203939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:06.205342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:06.225474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.226175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.226611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.226884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.239329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.240807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:06.259081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:06.260137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:06.261038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:06.261038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:06.261038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:06.261038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 446/896] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:06.266654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.308606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 451/897] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:06.324941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.343125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.383440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.399440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cad7f-de86-478c-aee3-b3f051cc7c41 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.459972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.460911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.461264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.461609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.462504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c6a8e-b276-4696-bc4d-c8c94d5953f9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.462749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:06.463130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.465078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.487239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 447/898] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:06.491565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.510121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.510776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.511048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.511369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.511960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.513395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:06.522851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:06.524022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:06.524912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:06.529390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 452/899] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:06.530466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.638256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5b5a5-ff36-4fe1-91a3-9a3f44acce38 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.638805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a16f0d-90a7-47b4-b6f5-c3df9f2207db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.649680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.676303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.682825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.683497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.683768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.684034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.684677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:06.684981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.686737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.692770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.693814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.694267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.694694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.697858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 453/900] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:06.699231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.705999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.707879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:06.726121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:06.727411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:06.728601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:06.731366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 448/901] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:06.738323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.846161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cdbe2-ca74-49c7-bf6d-5709e639244a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.858474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c320c0-611b-4c19-8e48-7eb2a1e09bdc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:06.883554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.884175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.884552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.884823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.885573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:06.885874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.887359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e0412-5013-496c-abbe-db14ad5380a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.896986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 454/902] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:06.897185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:06.897185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.897185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.897426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff95a1-a8a2-45d1-81ba-440bf0775b65 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.897509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.897592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff95a1-a8a2-45d1-81ba-440bf0775b65 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.897592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff95a1-a8a2-45d1-81ba-440bf0775b65 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.897725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:06.897725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:06.897725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:06.899364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 455/903] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:06.908819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:06.909128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:06.909353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:06.927775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 449/904] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:06.933357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:06.933591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:06.935116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:06.971057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:06.988235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.043478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 456/905] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:07.062508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.073331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588b2c-e5fc-4afd-b2f4-d1552e7394d1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.119720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.120344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.120619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.120893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.178109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe73111-db5e-483b-8341-739fa248bfe4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.192693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.194164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407688a-23f6-42c1-b5ff-4de411ea5a70 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.217042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.218483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.219081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.219577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.220472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.222129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:07.232170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:07.233268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 19:21:07.234106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:07.236940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 457/906] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:07.239182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.242637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.279248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.300424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 450/907] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:06 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 19:21:07.301742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127d62-6510-42dc-8825-a38c20d70271 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.302029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127d62-6510-42dc-8825-a38c20d70271 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.302305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03127d62-6510-42dc-8825-a38c20d70271 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.303745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 451/908] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:07.308365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03127d62-6510-42dc-8825-a38c20d70271 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.361352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da644-f21c-46d8-8ec5-7076835849f1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.397428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.398052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.398329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.398602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.399278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:07.399590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.400969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613eb0ff-d234-41df-b906-2d36f6cee3ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.406224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 458/909] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:07.407524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.407801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.408082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.427095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:07.428443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:07.439806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03127d62-6510-42dc-8825-a38c20d70271 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.478688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.479366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.479645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.479915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.491506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.493109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.495691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.507226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 459/910] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:07.507226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:07.522583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:07.523641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:07.524666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:07.524666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:07.524666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:07.524849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 452/911] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:07.525569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.536221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.616581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0119f0-548d-4999-a918-2ba7be59a1ef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.635794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8b3f0-5d7b-4e7f-a9ae-87ef3f50705b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.652374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.653099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.653266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.653570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.654152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:07.654629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.656050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.661702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 460/912] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:07.662510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.677029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.677684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.677959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.678228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.678876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.680229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:07.689034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:07.690061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:07.690991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 453/913] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:07.692696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.757954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.762307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:07.781720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a7bc-e24d-43a9-8e68-239c28ace628 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.821533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea52a9a-4557-4883-938a-ad78d68be80f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:07.821751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.822275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.822604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.822876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.823712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:07.824020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.825560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.838214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 461/914] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:07.839260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.870493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:07.871344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:07.871760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:07.872161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:07.873188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:07.875441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:07.899714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 454/915] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:07.900984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:07.969794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9aba-335c-4bd8-b901-bc0c0b207a3c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.017418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.018401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.018879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.019428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.020331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:08.020849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.022694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.030479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 462/916] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:08.040350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:08.054897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c34f8-7df3-458e-8c50-65180812db09 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.056840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:08.075810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:08.103535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.104255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.104564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.104848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.114216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.115814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:08.128839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:08.129808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:08.135658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 455/917] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:08.138199 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:08.182210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd48fd-d603-4c23-ba51-011c922f47dd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.232996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.233439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.233715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.233980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.234614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:08.234917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.236990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.244090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 463/918] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:08.250464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:08.283087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8d22-5504-47ad-92cf-ebe632ee12c5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.333396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.334035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.334302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.334570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.335309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:08.335613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.337237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.347587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:08.358168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 456/919] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:08.359545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:08.368569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820c7e-202e-4ea3-9a9a-e3e3c70ed485 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.395150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:08.405488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.406410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.406863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.407334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.408160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.409814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bfb8-497d-4a59-b8f1-ba2a8d5f07a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.444684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 464/920] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:08.482410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e769-e7ec-4427-804f-15054df0b015 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:08.529245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:08.530182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:08.530607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:08.531035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:08.531988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] RBAC: Adding query filter params (role.id=725539f40a45497bb9a2d9bfe0def3e0, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=35c6943e3d5a443eb84b719e0bb60885) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:08.532448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:08.534082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb89f8-4fb4-43eb-87ff-4bc744b67314 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:08.540899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 457/921] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:08 2022] GET /identity/v3/role_assignments?user.id=35c6943e3d5a443eb84b719e0bb60885&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=725539f40a45497bb9a2d9bfe0def3e0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:09.007057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deef3b-56cf-49f4-bf0a-ff3aa1c54cb2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:09.007658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deef3b-56cf-49f4-bf0a-ff3aa1c54cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:09.007658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deef3b-56cf-49f4-bf0a-ff3aa1c54cb2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:09.009223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 465/922] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:09.014972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccfa37-b8fb-4f38-9435-cca72238985d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:09.015508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccfa37-b8fb-4f38-9435-cca72238985d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:09.015692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccfa37-b8fb-4f38-9435-cca72238985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:09.036288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-64ccfa37-b8fb-4f38-9435-cca72238985d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:09.037510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-64ccfa37-b8fb-4f38-9435-cca72238985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:09.114046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 458/923] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:09.135732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deef3b-56cf-49f4-bf0a-ff3aa1c54cb2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:09.246186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deef3b-56cf-49f4-bf0a-ff3aa1c54cb2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:09.277340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:09.286537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:09.287165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:09.287480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:09.287986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:09.288667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:09.290055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ea7a7-ef52-4d9b-8ff6-423ca4269921 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:09.308902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 466/924] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:09 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:10.197627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4a7b-7bc0-4d6e-a495-4470245252b9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.198207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4a7b-7bc0-4d6e-a495-4470245252b9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.198584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4a7b-7bc0-4d6e-a495-4470245252b9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.200430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 459/925] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:10.206176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.206674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.206777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.226278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:10.227519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:10.307552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 467/926] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:10.327182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4a7b-7bc0-4d6e-a495-4470245252b9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:10.354477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:10.437112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4a7b-7bc0-4d6e-a495-4470245252b9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:10.475364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:10.476057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.476339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.476612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.477274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:10.478723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:10.481409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING keystone.server.flask.common [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 19:21:10.500629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.sql.core [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 19:21:10.500629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 19:21:10.500629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [parameters: {'id': '9471bd3c819843edb3a96fe09b0ecf93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 19:21:10.500629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80291) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-94688b61-d829-4a5f-8c15-90acee99ed73 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9471bd3c819843edb3a96fe09b0ecf93.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9471bd3c819843edb3a96fe09b0ecf93. Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:21:10.508464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 19:21:10.509290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application yield resource Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise self.value Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application session.commit() Aug 07 19:21:10.510662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.flush() Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application compat.raise_( Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 19:21:10.511817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 19:21:10.512723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:21:10.513520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [parameters: {'id': '9471bd3c819843edb3a96fe09b0ecf93', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.514473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:10.516978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9471bd3c819843edb3a96fe09b0ecf93. Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:10.519107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 460/927] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Aug 7 19:21:10 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:10.520383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:10.553464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14b47-5ef1-400b-8b64-ab94f702ffe9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.553785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14b47-5ef1-400b-8b64-ab94f702ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.554007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14b47-5ef1-400b-8b64-ab94f702ffe9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.562236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 461/928] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:10.564235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.564522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.564792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.590113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:10.592011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:10.628110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27063-9cb0-4766-9fd5-ef931884ad7c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:10.643761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:10.668310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:10.669324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.669797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.670420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.677764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:10.679558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:10.687235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 462/929] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:10.698220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:10.699392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:10.700407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:10.702557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 468/930] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:10.709001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:10.710497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:10.723611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:10.821170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e866a-1b4e-491b-b7d4-3b17f86438d2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:10.834208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f90f0-52d3-4492-a9ac-02ee49f08db1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:10.862234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:10.863120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.863457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.863693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.865018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:10.865329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:10.867424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:10.869526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:10.870332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.870439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.870695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.871884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:10.872657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-34145465-fdfd-48f4-bbcd-c3719ef074d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:10.881835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:10.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:10.889645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 469/931] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:10.891599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3201c5-464e-4361-aa10-420343351e6d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.891599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3201c5-464e-4361-aa10-420343351e6d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.891599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3201c5-464e-4361-aa10-420343351e6d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.891599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 470/932] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:10.892160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:10.892300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:10.892579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:10.903687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 463/933] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:10.903687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:10.920973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:10.922303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:10.966496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.006328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.019710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 471/934] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:11.037029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.059417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06f73-280d-4619-a759-788fb4ca4334 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.116011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.116712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.116987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.117565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.118356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:11.118659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.120118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.126092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 464/935] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:11.133009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.169590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad6d6a-46e0-4ae3-9339-22af1f2da76f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.212091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.214821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.215391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.215881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.230732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:11.239384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:11.240448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:11.241388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:11.244554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 472/936] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:11.250815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.254998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c77f-f906-4f6c-861d-b89f23e5e654 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.291592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.293709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.294685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.295161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.295728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.296737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:11.297339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.299141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6096-d2e3-4b9e-a51e-2b75ea2994ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.300999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.307050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 465/937] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:11.364022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41268-81b1-48e1-bdb6-e4a21c1423ae None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.364374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41268-81b1-48e1-bdb6-e4a21c1423ae None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.364556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e41268-81b1-48e1-bdb6-e4a21c1423ae None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.366288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 466/938] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:11.371869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.372184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.372409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.388516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b768d-d645-4205-a67f-6db2bd8a9ca1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.399160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:11.401906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:11.434940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.435683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.436024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.436295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.437494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:11.437494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.438670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.448428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 473/939] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:11.454063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.504871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 467/940] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:11.527046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.586067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.599093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58928076-211f-4fe0-acbb-97975acb4700 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.641469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.642193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.642478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.642750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.649291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b57896-6d83-4328-b110-6728899be8e0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.656606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.658131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:11.676823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:11.678171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:11.679574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:11.679574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:11.679574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:11.683453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 474/941] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:11.684542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.690407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.701978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.703187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.703696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.704294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.705499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.707406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:11.719694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:11.721043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:11.722095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:11.724838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 468/942] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:11.730607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.801073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80847-8184-4209-9da0-cb5a2529bb41 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.838253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.838884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.839159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.839466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.840127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:11.840431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.842077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.855499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 475/943] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:11.857242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953459c1-f895-411f-a7de-26c01ce9b5fd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:11.863070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.866280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.899607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:11.900139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:11.900412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:11.900679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:11.901316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:11.901665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:11.902984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:11.914028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 469/944] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:11.916057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:11.974233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:11.982300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbd06-0d6e-4b20-ac3e-32d289918272 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.019047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.019926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.020301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.020651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.022637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950ace-e83c-4268-841f-fbc7f5e34fce None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.029342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.031228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:12.044947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:12.046055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:12.047025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 476/945] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:12.052792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.070200 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.070835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.071141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.071871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.072600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:12.073085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.074661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.087561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 470/946] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:12.088739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.154435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:12.213294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737d729-46ea-42e6-86b1-68fa0df47efe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.233273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b9083-cc91-4691-840d-d5d645b931af None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.256808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.257444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.257989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:12.258506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.259606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.260960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:12.261828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.264090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.275584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.276071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.276356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.276630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.277351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] RBAC: Adding query filter params (interface=public, service_id=f495191f3c6e4060911ad5b4142190ea, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:12.277661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.279133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.286091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 477/947] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:12.291239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 471/948] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/endpoints?service_id=f495191f3c6e4060911ad5b4142190ea&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:12.292276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.293452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.412356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb3a24-420d-4385-a962-417e8401bd45 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.429989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28298b-ca13-4c44-b3b6-114b3b1dcf40 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.458341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:12.459025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.459965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.460463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.461106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.473268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.475098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.478819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.479525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.479825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.480118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.480798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.482258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:12.493888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:12.494958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:12.496471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:12.496471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:12.496471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:12.503374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 478/950] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:21:12.503798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 472/950] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:12.504598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.630033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0429-71d7-49e0-9004-861cb15c8fe1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.675035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.676000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.676453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.676906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.677758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:12.678222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.679872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.694965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 479/951] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:12.703363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.745824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:12.823183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16575309-b18c-4ab9-8830-5c5fa04706a0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:12.863456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:12.864118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:12.864390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:12.864656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:12.872600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:12.874127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:12.886201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:12.887166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:12.888104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 473/952] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:12.893932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:12.943433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:12.999638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db774c6-4dbc-4b61-bfe9-4464da5bded6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.034691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.035343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.035619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.035884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.036585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:13.036952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.038495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc91c-a056-4e67-acfc-28d21ffa7b41 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.053702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 480/953] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:13.059931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:13.065087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5267-5199-466e-bf25-7a3efca378c0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.065364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5267-5199-466e-bf25-7a3efca378c0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.065640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5267-5199-466e-bf25-7a3efca378c0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.068664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 481/954] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:13.072969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.073239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.073514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.094503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:13.095790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:13.169966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:13.175517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 482/955] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:13.177886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48e7b-87a1-45b2-b797-956eb98d5b61 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.199412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:13.214411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.215121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.215426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.215701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/35c6943e3d5a443eb84b719e0bb60885/roles/725539f40a45497bb9a2d9bfe0def3e0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.217903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=35c6943e3d5a443eb84b719e0bb60885, role_id=725539f40a45497bb9a2d9bfe0def3e0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.219666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.237305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 474/956] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:21:13 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/35c6943e3d5a443eb84b719e0bb60885/roles/725539f40a45497bb9a2d9bfe0def3e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:21:13.258048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:13.312802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af12c-fce1-4e91-958c-b60b69c0f302 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.359860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.360551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.360828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.361101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.361769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.363400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.366161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING keystone.server.flask.common [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 19:21:13.381515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 19:21:13.381515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 19:21:13.381515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [parameters: {'user_id': '66f76f75c89249d08869ae799276d37b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 19:21:13.381515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9b774a4e-4487-43f2-b2e5-b793f7255361 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() Aug 07 19:21:13.398912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:21:13.399912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 19:21:13.401121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 19:21:13.402023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 19:21:13.403544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 19:21:13.404775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'user_id': '66f76f75c89249d08869ae799276d37b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:13.405932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 19:21:13.406810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:13.412772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 483/957] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Aug 7 19:21:13 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:13.414828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:13.532526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab4f81-68ee-4f9a-a794-eedd61eb0b53 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.568454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.569098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.569370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.569635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.577801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.579283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:13.592117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:13.593224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:13.594473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 475/958] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:13.600270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d548-0beb-4481-9d2a-33684e53def0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.600553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d548-0beb-4481-9d2a-33684e53def0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.600832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27d548-0beb-4481-9d2a-33684e53def0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.602292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:13.605591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 484/959] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:13.610731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.611015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.611316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.624669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:13.636891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:13.636891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:13.711386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1e88-4a2b-4860-a278-178f7fa42a67 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.715320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 485/960] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:13.737879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:13.757322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.758679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.759184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.759677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.760881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:13.761881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.763693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a925e0-020a-46b7-9e8a-ee8bcdf478d4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.773407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:13.821980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 476/961] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Aug 7 19:21:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:13.866040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f8e68-2eb3-4cc5-b37f-d55572aae214 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:13.906534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:13.907179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:13.907486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:13.907756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:13.908430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:13.910020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c196dc-29cb-4150-9147-aaed7ecb9d67 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:13.931921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 486/962] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:13 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:14.656120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e0ef3-bfd7-48f0-92e3-f961e6274dd5 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:14.656682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e0ef3-bfd7-48f0-92e3-f961e6274dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:14.656682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e0ef3-bfd7-48f0-92e3-f961e6274dd5 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:14.657961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 477/963] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:14.663770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:14.664271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:14.664271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:14.682584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:14.683714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:14.774402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 487/964] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:14.797489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e0ef3-bfd7-48f0-92e3-f961e6274dd5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:14.883909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:14.914584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e0ef3-bfd7-48f0-92e3-f961e6274dd5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:14.951323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:14.952032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:14.952328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:14.952602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:14.953204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:14.954617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:14.964390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:14.965451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:14.966344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:14.967974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 478/965] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:14.971821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:14.986920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:15.103073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab115-f39e-4a73-b33f-4e8e3e9862ee None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:15.140258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:15.140882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.141154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.141419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.142065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:15.142358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:15.143807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2766-57a3-4f84-84a7-30220ec602f3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:15.149360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 488/966] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:15.155116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:15.276709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4af54-a2a8-468d-a9a3-95bb1043b4df None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:15.311978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:15.312615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.312895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.313168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.313372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ecafe-2afb-4c4b-8a5d-bf2a2209db18 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.313656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ecafe-2afb-4c4b-8a5d-bf2a2209db18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.313809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:15.313957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ecafe-2afb-4c4b-8a5d-bf2a2209db18 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.314138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:15.315287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 489/967] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:15.315809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:15.320716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.320986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.321250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.326828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 479/968] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:15.327954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:15.332435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:15.342145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:15.343490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:15.417965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 490/969] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:15.445597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:15.452912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa4fc-7b67-4c4c-ab93-0a4713f87645 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:15.454639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:15.504614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:15.505784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.506062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.506334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.507027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:15.509267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:15.532366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 480/970] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:15.586109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70efcc1-15c2-49e3-a9f7-691037d0b716 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:15.639959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:15.640621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.640939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.641208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.653448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:15.658528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:15.668931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:15.669792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 491/971] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:15.670557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:15.739328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:15.790905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09b5a-03a4-4c20-9eda-f1e0ad0a3793 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:15.830827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:15.831544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:15.831798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:15.832085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:15.832778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:15.833066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:15.834466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca694694-a555-4d36-919a-4cd410a0fbc9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:15.846201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 481/972] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:15.852671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:15.977162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.047061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a239d91-e79a-4402-aed9-409b225dd1b8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.088756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.089409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.089681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.089946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.102367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.103886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.110689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ff47-d411-4622-87a7-f3476efafa68 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.111171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ff47-d411-4622-87a7-f3476efafa68 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.111685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087ff47-d411-4622-87a7-f3476efafa68 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.114989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 482/973] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:16.120352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:16.121334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:16.127163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:16.127163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:16.127163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:16.127163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 492/974] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:16.127439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.127439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.127439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.127623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.148497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:16.150211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:16.228141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 483/975] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:16.253527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.277482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87d4-d0ea-49d4-af22-ec3e4c5060f3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.295613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.321493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.325716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.326196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.326408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.326902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.328134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:16.328476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.330311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.345428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 493/976] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:16.352498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.389365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c86e7-bf94-46a7-bbd4-d8c28ec4d1ca None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.444967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.445702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.445906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.446179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.446780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.448188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:16.458470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:16.460690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:16.462155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 484/977] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:16.468934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.503017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a8d1-c00d-47be-b879-93de3a6e3c0f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.556563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.557505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.557833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.558113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.568264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.570368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:16.588937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:16.589960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:16.590935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 494/978] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:16.596143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.616003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6d64-21f4-4e52-938c-95a31e11089b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.637924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.639754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.665743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.666817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.667221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.667607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.668298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:16.668597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.670027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.681638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 485/979] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:16.682890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.760763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201dda-d51f-4a35-914e-7e85b0d54002 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.817507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.818765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.819425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.819924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.820984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:16.821459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.821750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7a89-9330-4d59-8516-e1477271dc47 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:16.823776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.856500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 495/980] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:16.864426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.885256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:16.886102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:16.886439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:16.886796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:16.887645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:16.887946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:16.889398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:16.894998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 486/981] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:16.901098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:16.954005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.981196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:16.992864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfad78-eeaa-4268-8609-feced6e76236 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.022738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b22e36-d8e9-4a7f-a2e3-fb6f124eeba0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.034539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.035473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.035753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.036019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.061804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.062447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.062722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.062996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.063755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] RBAC: Adding query filter params (interface=public, service_id=36c43d26d7854bb88b5c81d37dc12d55, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:17.064073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.065481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.071628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 487/982] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/endpoints?service_id=36c43d26d7854bb88b5c81d37dc12d55&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:17.077801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:17.122646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.124696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.201838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fd225-af27-4807-bf2c-c3f95236ba53 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.209386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:17.243810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.244640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.244929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.245201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.246324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.248213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.256041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 488/983] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:21:17.258135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:17.269062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 496/984] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:16 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:17.275144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:17.402517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f681-9938-4bb6-8dcb-774ffd2b5562 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.459878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.460551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.460835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.461094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.473810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.475354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-471c6f3a-b973-4da3-8088-a6e625a4cae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:17.491605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:17.493201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:17.494516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:17.494516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:17.494516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:17.494516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 489/985] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:17.503653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:17.654006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0dce5-00f3-429a-b7b5-17ee0293a2c7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.656165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d57-e801-48f1-a146-ea6fe8b6c051 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.656450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d57-e801-48f1-a146-ea6fe8b6c051 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.656728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d57-e801-48f1-a146-ea6fe8b6c051 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.658251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 490/986] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:17.663751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.664036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.664299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.683940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:17.685238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:17.705363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.706013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.706276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.706563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.707430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:17.707738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.709922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.711058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:17.725459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 497/987] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:17.731178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:17.784255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 491/988] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:17.805510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:17.807236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:17.894881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319d19-56da-4fe3-a692-0d927f74e63b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.953317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:17.954141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:17.954422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:17.954692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:17.962508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7e280-1c15-4c40-84eb-dd546d0ca3b8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:17.963652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:17.965901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:17.979224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:17.980228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:17.981116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 498/989] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:17.986675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.012464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.013242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.013526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.013788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.014480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.015902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:18.026635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:18.027763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:18.028617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:18.031367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 492/990] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:18.036269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.061348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:18.124904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324eaf81-1eff-466f-b1cf-4e16231f43aa None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.141372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:18.165601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.166226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.166504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.166772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.167502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:18.167801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.169229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.177169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9305-9842-4cbd-bd3d-a09708041685 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.182957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 499/991] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:18.189271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.223362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.223883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.224172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.224440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.225077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:18.225882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.226855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.232657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 493/992] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:18.240677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.346285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96436698-1aab-42d1-9239-d18e95fa0230 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.352100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:18.380802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a9d64-f0ba-4e7c-b58c-3f1feb6f0202 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.394170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.394942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.395297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.395750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.396914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] RBAC: Adding query filter params (role.id=725539f40a45497bb9a2d9bfe0def3e0, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=35c6943e3d5a443eb84b719e0bb60885) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:18.397410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.399023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.409104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 500/993] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:18 2022] GET /identity/v3/role_assignments?user.id=35c6943e3d5a443eb84b719e0bb60885&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=725539f40a45497bb9a2d9bfe0def3e0 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:18.430193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.431156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.431699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.432125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.433553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:18.434084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.435762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.443054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 494/994] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:18.449212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.502783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:18.592847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222d9c8-5a07-47b2-adfc-796b39dbcf89 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.633049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.633676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.633957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.634228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.634951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] RBAC: Adding query filter params (interface=admin, service_id=f495191f3c6e4060911ad5b4142190ea, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:18.635315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.636711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2dc5-7156-4737-8a1c-97b7e4398213 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.645691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 501/995] 10.222.0.15 () {56 vars in 1249 bytes} [Sun Aug 7 19:21:18 2022] GET /identity/v3/endpoints?service_id=f495191f3c6e4060911ad5b4142190ea&interface=admin®ion_id=RegionOne => generated 193 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:18.651538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:18.763139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d1f6b-3186-419e-aacc-edc606fcf57c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:18.804809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:18.805419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:18.805694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:18.806006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:18.806605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:18.808025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07748b-7e45-47b9-881c-dbbb0a1dcc50 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:18.815424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 495/996] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:18 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:21:19.359026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca051b-be20-489c-9af5-84ec6f42dac4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:19.359593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca051b-be20-489c-9af5-84ec6f42dac4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:19.359593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca051b-be20-489c-9af5-84ec6f42dac4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:19.361024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 502/997] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:19.366312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:19.366605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:19.366876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:19.385308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:19.386492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:19.388585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:19.475239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 496/998] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:19.496343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca051b-be20-489c-9af5-84ec6f42dac4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:19.598952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:19.603553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca051b-be20-489c-9af5-84ec6f42dac4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:19.637781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:19.638444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:19.638690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:19.638981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:19.639760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:19.641127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:19.649936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:19.651021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 19:21:19.651914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:19.656230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 503/999] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:19.657548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:19.766337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17eec-f0ee-47b0-a719-093010dc2ed9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:19.802711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:19.803382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:19.803663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:19.803936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:19.804570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:19.804874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:19.806239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:19.818213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 497/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:19.819501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:19.934941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5f62-75f1-49f2-8a08-fc8512d244b4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:19.981959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:19.982582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:19.982883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:19.983177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:19.983892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:19.984190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:19.985544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33252-c899-4f51-982d-1f82620aca78 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:19.991041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 504/1001] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Aug 7 19:21:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:19.996571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:19.999590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:20.109121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d9a6f-df03-4c7b-aff4-70a1120f560d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:20.143302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:20.143917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.144190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.144451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.145156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:20.146520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbb0d0-e834-4963-bb52-2275404d47c1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:20.174974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 498/1002] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:20.465336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c44-4a49-4cb5-900e-5da9d509fbe7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.465884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c44-4a49-4cb5-900e-5da9d509fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.465884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58c44-4a49-4cb5-900e-5da9d509fbe7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.467468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 505/1003] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:20.472699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.472959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.473250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.491885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:20.493074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:20.556897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:20.582993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 499/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:20 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:20.604655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58c44-4a49-4cb5-900e-5da9d509fbe7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:20.635265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:20.715390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58c44-4a49-4cb5-900e-5da9d509fbe7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:20.753119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:20.754196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.754668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.755150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.755965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:20.757539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5433ecc6-cb31-4b1b-b6c0-fddb951a0995 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:20.768318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:20.769455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:20.770304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:20.772849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 506/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 19:21:20 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:20.781661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:20.871342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9e4e-7e1b-4678-b9e3-14a548229dc2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.871691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9e4e-7e1b-4678-b9e3-14a548229dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.871883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9e4e-7e1b-4678-b9e3-14a548229dc2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.873245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 507/1006] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:20.878500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.878779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.879043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.897354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:20.898563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:20.900798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11932-e5f2-487c-b9cc-dc9f10dddff2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:20.936485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:20.937119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:20.937405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:20.938277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:20.938392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] RBAC: Adding query filter params (name=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:20.938618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:20.940044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:20.946131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 500/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:20.952074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:20.983298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 508/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:20 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:20.995786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:21.006724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:21.021928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:21.070121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606155b-6b2e-442a-9825-4d843f741a0e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:21.104441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d66c7-2a11-4d44-b546-b4f54f882168 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:21.106369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:21.106998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:21.108496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:21.108496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:21.108496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] RBAC: Adding query filter params (type=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:21.109726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:21.111116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:21.116339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 501/1009] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:21.146160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:21.147360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:21.147934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:21.148402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:21.149228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:21.150899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:21.162130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:21.163325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 19:21:21.164214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:21.170781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 509/1010] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Aug 7 19:21:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:21.171357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:21.304819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792bb6-7f8c-4388-8dc8-9c6750c604ab None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:21.321212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:21.347265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:21.348316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:21.348590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:21.348868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:21.349515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:21.349834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:21.351444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:21.357392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 502/1011] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:21.363552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:21.466923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:21.484231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf1983-c22b-479b-8f16-1b275d0d0b34 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:21.521409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:21.522022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:21.522284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:21.522567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:21.523324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:21.523521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:21.524897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d90fb-91bb-48c9-850a-daf465b99e14 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:21.534732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 510/1012] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Aug 7 19:21:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:21.536281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:21.646112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdcd85-205c-41e4-8319-0244f2a7dd18 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:21.681817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:21.682450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:21.682725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:21.682983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:21.683772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:21.685168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e750310-0e75-4903-85ec-c309424e733b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:21.711251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 503/1013] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:22.289598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259828-6462-4863-9219-ce3ff58b169b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:22.290075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259828-6462-4863-9219-ce3ff58b169b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:22.290355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259828-6462-4863-9219-ce3ff58b169b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:22.291912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 511/1014] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:22.297373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:22.297890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:22.297890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:22.317256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:22.318496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:22.352880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:22.414738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 504/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:22 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:22.440049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c259828-6462-4863-9219-ce3ff58b169b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:22.549049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c259828-6462-4863-9219-ce3ff58b169b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:22.584457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:22.585097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:22.585372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:22.585642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:22.596815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:22.601554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:22.602512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:22.608610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 512/1016] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:22.610714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:22.719745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66585f-f186-40ab-bbf9-a023405535e2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:22.755749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:22.756363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:22.756647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:22.756899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:22.757743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:22.757743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:22.759485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:22.772649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 505/1017] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:22.774052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:22.789046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:22.887349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942470e8-59c6-4d73-a94c-58db00c88fd4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:22.923307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:22.923953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:22.924232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:22.924503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:22.935111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:22.936747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-800ecbf7-3a1a-4403-8406-fa2ff673abb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:22.951996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:22.953089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:22.954156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:22.954156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:22.954156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:22.954156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 513/1018] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:22.958713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:22.986848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.070290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0f137-f56a-4300-916b-7149aef5840c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.108562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:23.109191 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.109472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.109740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.110402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:23.110679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:23.112128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:23.123165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362581-975b-4058-a885-a3c7ce0e2112 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.125661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362581-975b-4058-a885-a3c7ce0e2112 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.125940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23362581-975b-4058-a885-a3c7ce0e2112 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.131100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 506/1019] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:23.131254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 514/1020] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:23.132015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.132579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.132873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.133134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.152780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:23.153899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:23.213002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.224834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 515/1021] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:23 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:23.225355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.243010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23999c9a-d803-4073-8591-e96b8e7ab616 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.247024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.288006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:23.289142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.289398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.289697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.299819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:23.301310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:23.314034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:23.315069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:23.321238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 507/1022] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:21:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:23.322245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.358497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed231d1-2455-4a6a-ae06-2a7e006de21f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.396702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:23.397332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.397605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.397883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.398543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:23.399971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:23.417412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 516/1023] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:23 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:23.444333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cff75-147a-4284-80bd-feb23edb81e0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.492394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:23.493033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.493313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.493584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.494386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:23.494653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:23.496179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d347a-d1c6-435d-8494-09db8578981e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:23.507292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.524315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 508/1024] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:21:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:23.525907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.591251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.652228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9ba8-8396-4a79-b6ce-fc61b3b39753 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.689993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:23.690657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.690933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.691221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.738217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0af3-38b2-4022-be1b-706333147057 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.738623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0af3-38b2-4022-be1b-706333147057 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.739267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0af3-38b2-4022-be1b-706333147057 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.740796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 509/1025] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:23.746058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:23.746352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:23.746628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:23.764692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:23.765892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:23.766245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:23.767436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:23.824133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:23.844555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 510/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:23.867402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.885298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 517/1027] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:23.886791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:23.978994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354144-68d9-450f-95b3-0122ed4571a9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:23.995557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d52c91-a021-4fa1-8cd3-62eaed1abd2b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.008577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:24.018622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.019298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.019577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.019845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.020989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.022449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.024146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 511/1028] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:24.031023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:24.036891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.037082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.037298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.037579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.049328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.050772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:24.071333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:24.072494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:24.073489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:24.073489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:24.073489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:24.081320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 518/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:24.082761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:24.090087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:24.187057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aeb75-5fcd-4cbc-91de-c1eec055cd17 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.240876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.241738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.242194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.242643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.243630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.246100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.247156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867a127-a347-43ad-9292-c7cc9c933f61 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.294370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 512/1030] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:24 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:24.306036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.306686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.306966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.307287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.308080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:24.308481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.310107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.324687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 519/1031] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:24.330848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:24.403177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:24.475169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb720e-a881-4401-954b-9939b49228fa None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.511890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.512461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.512740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.513009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.521548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.523012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:24.534738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:24.535853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:24.537407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 513/1032] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:24.542347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:24.613643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:24.657188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e32b4-7b51-4d7e-8dfa-43ab09a2657e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.708809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.709491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.709774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.710050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.710774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:24.711084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.712594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8ac0-7291-4897-972e-0beb29125391 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.735428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 520/1033] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:24.738222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:24.861805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43724ff-1f3c-42f1-bc81-0880daeec6c2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:24.871958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:24.898842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:24.899903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:24.900408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:24.900906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:24.903310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] RBAC: Adding query filter params (role.id=725539f40a45497bb9a2d9bfe0def3e0, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:24.903697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:24.905631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af6d0-7c3d-46d3-8f58-7c1638d1e0f7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:24.919225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 514/1034] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:24 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=725539f40a45497bb9a2d9bfe0def3e0 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:25.442359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a9b4-1d32-42f9-b10c-193ba5c6f76e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:25.442673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a9b4-1d32-42f9-b10c-193ba5c6f76e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:25.442897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a9b4-1d32-42f9-b10c-193ba5c6f76e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:25.444515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 521/1035] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:25.449459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:25.449909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:25.450020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:25.468354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:25.469541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:25.544297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 515/1036] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:25.566361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a9b4-1d32-42f9-b10c-193ba5c6f76e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:25.683497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a9b4-1d32-42f9-b10c-193ba5c6f76e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:25.707423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:25.718994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:25.719675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:25.719927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:25.720211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:25.720793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:25.722148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:25.730822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:25.732038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:25.733461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:25.735580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 522/1037] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 19:21:25 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:25.737923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:25.843603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5effda-4abf-448b-8cce-de6d1f25ff51 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:25.845305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:25.882205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:25.882822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:25.883097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:25.883415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:25.884055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] RBAC: Adding query filter params (name=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:25.884358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:25.885740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:25.896247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 516/1038] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:25.897236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:26.002310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bc8d5-4eb0-4d90-802a-bb5b1d774ab0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:26.041411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:26.042029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.042304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.042572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.043220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] RBAC: Adding query filter params (type=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:26.043536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:26.044956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:26.050725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 523/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:26.056800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:26.164005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ad0-e574-4cd7-8110-0a9971bc0eeb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:26.199626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:26.200249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.200525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.200792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.201494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] RBAC: Adding query filter params (interface=public, service_id=ba6a8a1df07e4169a17bf270e6bb9b91, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:26.201859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:26.203250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d085d97-f400-4cbf-a5c1-eee37a2291b1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:26.212906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 517/1040] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:21:26 2022] GET /identity/v3/endpoints?service_id=ba6a8a1df07e4169a17bf270e6bb9b91&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:26.213933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:26.273734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:26.322118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa95e8-f5ff-47db-8e1e-2b43d0fc4e18 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:26.356819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:26.357438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.357709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.358129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.358884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:26.360296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbccf-fa9f-49bd-8676-683c35e870ae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:26.366623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d689-4aa0-474b-831c-d1eef9825dba None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.366892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d689-4aa0-474b-831c-d1eef9825dba None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.375436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d689-4aa0-474b-831c-d1eef9825dba None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.375749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 524/1041] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:21:26 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:21:26.375852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 518/1042] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:26.375951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.375951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.375951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.394764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:26.396032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:26.480821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 525/1043] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:26.505215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51d689-4aa0-474b-831c-d1eef9825dba None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:26.539802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:26.618048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51d689-4aa0-474b-831c-d1eef9825dba None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:26.654312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:26.655017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.655320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.655583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.656741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:26.658196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c83da-7d59-4a8b-8843-b8568aeb64c7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:26.659963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 519/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:26.665684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:26.714898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:26.772308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579ea4-618f-43db-a5d5-cfc8a51c325f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:26.807674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:26.808191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.808461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.808726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.809387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:26.810816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98dd88-daec-4393-8e55-567b3bb15610 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:26.837189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 526/1045] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:21:26 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:26.906778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd7d-19df-4e85-ba8b-809564e119cf None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.907067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd7d-19df-4e85-ba8b-809564e119cf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.907369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd7d-19df-4e85-ba8b-809564e119cf None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.909006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 520/1046] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:26.915631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:26.916063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:26.916477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:26.941431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:26.943104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:27.025764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 527/1047] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:27.049137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdcd7d-19df-4e85-ba8b-809564e119cf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:27.159343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:27.165256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdcd7d-19df-4e85-ba8b-809564e119cf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:27.202459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:27.203176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:27.203487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:27.203757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:27.214271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:27.219102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:27.220158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:27.221033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 521/1048] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:27.226378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:27.259062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:27.347766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5fe01-c4f9-42c5-9932-210a2073590b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:27.388121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:27.388746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:27.389020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:27.389322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:27.390000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:27.390303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:27.391698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:27.400442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 528/1049] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:27.406347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:27.514370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35d3a-edb2-4537-b3f8-b013f264d66b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:27.550050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:27.550687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:27.550962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:27.551232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:27.561832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:27.563325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:27.579603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:27.580816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:27.582241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:27.582241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:27.582241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:27.583593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 522/1050] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:27.586518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:27.681653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:27.689843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619306c5-7a91-4161-b26c-f9a0d91aeb3d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:27.723492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:27.724239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:27.724460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:27.724616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:27.725254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:27.725552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:27.726903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:27.743711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 529/1051] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:27.745093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:27.758213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:27.851444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275272-a7a0-48e5-9cf9-be0f9b47b274 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:27.887233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:27.887870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:27.888142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:27.888403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:27.896257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:27.897726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:27.909258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:27.915562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:27.916833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 523/1052] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:27.918814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.039968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a48f5-07ce-4088-81fb-1fa52d60986a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.076938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.077558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.077835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.078097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.078906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:28.079224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.080731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.103614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 530/1053] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:21:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:28.105138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.177648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.211933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff38c-55ca-46a5-8778-39cbad79a3b1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.246415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.247053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.247358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.247624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.258556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.260046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-999eaca4-c12a-47ec-9014-899078f2c8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:28.274478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:28.281142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:28.282234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:28.282234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:28.282234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:28.282234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 524/1054] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:28.283762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.299789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.391974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542984-9b0b-471c-9867-fe608d51b01c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.404505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dd2e8-33bf-474c-91b2-cf986aa6a0d6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.404841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dd2e8-33bf-474c-91b2-cf986aa6a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.405117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dd2e8-33bf-474c-91b2-cf986aa6a0d6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.406663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 525/1055] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:28.411517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.411799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.412073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.430906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:28.432155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:28.434795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.435478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.435750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.436037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.436672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:28.436971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.438350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.450977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 531/1056] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:28.456857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.507564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 526/1057] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:28.530262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.540484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.572115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138952-70b6-4695-b279-dfb2d60775df None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.588390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.610867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.611672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.611852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.612104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.620181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.621659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:28.633763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:28.634815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:28.636431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 532/1058] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:28.640610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.644074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606baae-2432-4727-a041-78006b13cbf5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.678548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.679187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.679490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.679762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.680356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.681736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:28.691241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:28.692652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:28.694163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 527/1059] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:28.698627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.754037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d231b86-e6e4-44fd-9162-857b33307d6b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.783231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.792517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.793163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.793438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.793703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.794405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:28.794710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.796200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.809064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 533/1060] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:28.814804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.815271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec186-55d8-4651-ba57-8446809b85a3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.834141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:28.854153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.854863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.855217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.855563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.856280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] RBAC: Adding query filter params (name=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:28.856647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.858085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.863665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 528/1061] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:28.869103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:28.918132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dd1-8218-4e37-bfb0-ddb5d1dfa586 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.954003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:28.954667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.954936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.955220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/725539f40a45497bb9a2d9bfe0def3e0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.957516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=31fcd522972b4af7ab786a11af6938f6, role_id=725539f40a45497bb9a2d9bfe0def3e0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:28.958998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03573e67-3ba7-49de-8153-8b62f4d5f821 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:28.972814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fb4c8-d324-488c-b11a-880ba76ed231 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:28.973663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 534/1062] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:21:28 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/31fcd522972b4af7ab786a11af6938f6/roles/725539f40a45497bb9a2d9bfe0def3e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:21:28.974878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81334d-6d89-4f9a-aaad-efd6628685c4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.975167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81334d-6d89-4f9a-aaad-efd6628685c4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.975456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81334d-6d89-4f9a-aaad-efd6628685c4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:28.976705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 535/1063] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:28.982452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:28.982706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:28.983043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.002894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:29.004223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:29.014052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.014754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.015032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.015338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.015994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] RBAC: Adding query filter params (type=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:29.016298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:29.017702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:29.024923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 529/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:29.030991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:29.060971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:29.091334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 536/1065] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:21:29.091520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:29.110984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:29.159858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326eb8e-d3f6-4bc0-901a-485c9fd62f41 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:29.212507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.213479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.213896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.214307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.215119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:29.216676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:29.236163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bde60-270a-40d0-986b-8afa6ab7d003 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:29.240195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 530/1066] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:21:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:29.283165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.284179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.284594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.285024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.298051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:29.303356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:29.304418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:29.305312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:29.311572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 537/1067] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:29.312904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:29.432213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:29.436487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8f607-3d58-452c-bd5f-5c46bf5379d9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:29.476933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.477587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.477862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.478141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.478821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:29.479123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:29.480639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:29.490209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 531/1068] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:29.496053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:29.538978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:29.602922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24025-6763-47ce-a018-6b9db842cd21 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:29.638247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.638895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.639218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.639494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] PATH_INFO: `/v3/users/d9dba895705942aa98ffc58a5b5061bb` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.654997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d9dba895705942aa98ffc58a5b5061bb)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:29.656474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:29.658478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 538/1069] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:29 2022] GET /identity/v3/users/d9dba895705942aa98ffc58a5b5061bb => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:29.664152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:29.767612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1a76-994d-44aa-aea2-8531f1787a54 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:29.803161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:29.803816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:29.804087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:29.804352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:29.836306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:29.876024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:29.877469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:29.976719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 532/1070] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:29.982484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:30.091107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:30.098741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecec9f-6ad4-4c61-8daf-b3a8e1e377a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:30.133305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:30.133951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:30.134227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:30.134471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:30.135669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:30.137107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f816b0-8a98-4ed3-8552-8fac4e3d0a61 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:30.143765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 539/1071] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:29 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:30.145095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:30.217849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:30.261851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd02071-6bb7-4e87-a992-9bd7996afdd1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:30.297415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:30.297415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:30.297906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:30.297991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:30.298666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=aa641f9631694d96a7777f7422e0b8d2, user.id=d9dba895705942aa98ffc58a5b5061bb) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:30.298969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:30.300424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b98a99-81a6-4241-96f0-2d01dde5bcfb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:30.306201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 533/1072] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:30 2022] GET /identity/v3/role_assignments?user.id=d9dba895705942aa98ffc58a5b5061bb&scope.project.id=aa641f9631694d96a7777f7422e0b8d2&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:31.071018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812c11-5881-4391-a600-a0122dae06e5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.071595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812c11-5881-4391-a600-a0122dae06e5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.071595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812c11-5881-4391-a600-a0122dae06e5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.073228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 540/1073] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:31.078724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614e3d-c0f2-460c-b95d-86180b20c367 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.079230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614e3d-c0f2-460c-b95d-86180b20c367 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.079317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614e3d-c0f2-460c-b95d-86180b20c367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.098583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c9614e3d-c0f2-460c-b95d-86180b20c367 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:31.099823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c9614e3d-c0f2-460c-b95d-86180b20c367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:31.172077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 534/1074] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:31.195715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812c11-5881-4391-a600-a0122dae06e5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.302355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812c11-5881-4391-a600-a0122dae06e5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.310387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc6e4-9480-467a-abcc-1742459cc0e1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.310764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc6e4-9480-467a-abcc-1742459cc0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.311109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc6e4-9480-467a-abcc-1742459cc0e1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.312557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 535/1075] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:31.318324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.318675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.318878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.338332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:31.339492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:31.341963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.342782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.343060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.343365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.355249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:31.359588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:31.360561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 19:21:31.361407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:31.365844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 541/1076] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:31.366902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.395426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.402131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.417216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 536/1077] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:31.438745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.489894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baded7a-3a95-4c83-a426-57344ca30687 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.528698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.529681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.530253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.530911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.531826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:31.532357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:31.534140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:31.538972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021aeee-ee17-4580-ae05-c1b9197d9552 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.547579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 542/1078] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:31.548883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.575804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.576423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.576724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.576991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.636750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.639794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.651714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:31.653298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:31.658053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928b8e2-342c-4bfa-9e70-9700bcd616a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.697012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.697665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.697938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.698215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.710159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:31.711664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:31.726937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:31.728150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:31.729173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:31.729173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:31.729173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:31.729173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 543/1079] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:31.734253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.778119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 537/1080] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 19:21:31.784007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.844963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2173-30fc-4954-b9cd-92bf518be51e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.875814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.882367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.883076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.883470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.883810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.884466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:31.884774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:31.886147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:31.893293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f346-20a8-437d-bda7-0c9707ea8e97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:31.893752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:31.899701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 544/1081] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:31.905527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:31.936177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573970-271b-4561-8632-99cac6769dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:31.936907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573970-271b-4561-8632-99cac6769dea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:31.937186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573970-271b-4561-8632-99cac6769dea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:31.937454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573970-271b-4561-8632-99cac6769dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:31.948756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d573970-271b-4561-8632-99cac6769dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:31.950338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d573970-271b-4561-8632-99cac6769dea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0d573970-271b-4561-8632-99cac6769dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:31.966429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:31.967816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:31.968731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:31.968731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:31.968731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:31.968731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 538/1082] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:31.974718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573970-271b-4561-8632-99cac6769dea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.020978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a5ab8-fbdd-47a9-90b8-e9cfce83cf46 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.064133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.064950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.065293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.065635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.074406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.075899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.084686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573970-271b-4561-8632-99cac6769dea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:21:32.087501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:32.088477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:32.089441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 545/1083] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:32.094373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.127014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.127828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.127968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.128206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.128868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:32.129171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.130575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951d74e-3edb-4c2f-8bfc-e86bf86773a1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.138913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.156314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 539/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:32.171966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.225012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210d0e0-5512-48cf-bbb6-749d62883668 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.267940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.268574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.268848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.269148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.269874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:32.270215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.271881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.287998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f3b7-2759-48ee-8626-01960cb20b91 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.288332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f3b7-2759-48ee-8626-01960cb20b91 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.288332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f3b7-2759-48ee-8626-01960cb20b91 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.291256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 540/1085] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:21:32.296821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.297072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.297298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.297623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 546/1086] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:32.301908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.317483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:32.318718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:32.399733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 541/1087] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:32.418239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58956-7d35-42f0-8b1b-98f62c4a53e7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.423943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.445869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.466899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.467718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.467997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.468269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.531060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477fa8c-bc50-4bd7-a566-a54bcc394d18 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.535867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.537323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.557692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.567370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.568038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.568309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.568579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.579344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:32.583958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:32.585013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:32.585862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:21:32.588207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 542/1088] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:32.591162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.643030 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 547/1089] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:32.648941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.669952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.693525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456836-becf-4efa-843c-981eff4dcf97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.729955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.730578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.730871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.731129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.731862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:32.732161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.733617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.742485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 543/1090] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:32.748484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.775518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7d33-5f8d-47bd-bb6a-377a6891d6a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.802168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.819140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.819989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.820318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.820616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.832803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.834251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:21:32.849250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:32.850437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:21:32.851628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:21:32.851628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:21:32.851628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:32.851628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 548/1091] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:21:32.856246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.859807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee569-0854-4cfa-8ef8-ed6c5d2263c0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.894323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.894980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.895286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.895561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] PATH_INFO: `/v3/users/d9dba895705942aa98ffc58a5b5061bb` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.896749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] RBAC: Authorizing `identity:get_user(user_id=d9dba895705942aa98ffc58a5b5061bb)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.898197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:32.899842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 544/1092] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/users/d9dba895705942aa98ffc58a5b5061bb => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:32.905626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:32.923042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:32.960414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c22e-619c-4ff1-a70f-841e51c02c98 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:32.994898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:32.995551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:32.995833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:32.996105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:32.996763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:32.997064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:32.998447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.008138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756ec65-fd50-4868-9616-e3bc9c66978c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:33.010571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 549/1093] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:33.016645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:33.026582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:33.045149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:33.045909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:33.046186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:33.046455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:33.047619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:33.049068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.050904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 545/1094] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:32 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:33.058040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:33.123345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600388e-dadb-4e61-932d-dd2fb9527e86 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:33.152126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:33.161758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:33.162594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:33.162864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:33.163127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:33.168128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062a14-573b-4ebc-8884-32953dc23b15 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:33.170486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:33.171990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:21:33.183943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:33.185148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:33.186050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 550/1095] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:33.191088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:33.202941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:33.205430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:33.205701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:33.205971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2/users/d9dba895705942aa98ffc58a5b5061bb/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:33.207910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa641f9631694d96a7777f7422e0b8d2, user_id=d9dba895705942aa98ffc58a5b5061bb, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:33.209419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.224760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 546/1096] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:21:33 2022] PUT /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2/users/d9dba895705942aa98ffc58a5b5061bb/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:21:33.304042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58db10-ba54-4ccc-86c5-832735c1b888 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:33.344128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:33.344763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:33.345040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:33.345306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:33.346019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:33.346325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:33.347851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bae65-e209-46ed-9f65-4f758cbbd581 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.362820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 551/1097] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:33.369413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:33.424239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:33.484312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37c9bc-48bd-439c-8240-4bd7e1a48155 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:33.521457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:33.522104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:33.522352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:33.522644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:33.523416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] RBAC: Adding query filter params (role.id=725539f40a45497bb9a2d9bfe0def3e0, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=31fcd522972b4af7ab786a11af6938f6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:33.523696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:33.525157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52e92-001b-432c-bbd2-8391fbd2aff0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:33.543234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 547/1098] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:33 2022] GET /identity/v3/role_assignments?user.id=31fcd522972b4af7ab786a11af6938f6&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=725539f40a45497bb9a2d9bfe0def3e0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:35.237297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87276d0-8170-49da-95b0-d6df3d5fb6b6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.237869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87276d0-8170-49da-95b0-d6df3d5fb6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.237869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87276d0-8170-49da-95b0-d6df3d5fb6b6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:35.239175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 552/1099] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:35.244522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.244989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.245162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:35.264183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:35.265518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:35.336471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 548/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:35.359604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87276d0-8170-49da-95b0-d6df3d5fb6b6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:35.411954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:35.468892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87276d0-8170-49da-95b0-d6df3d5fb6b6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:35.504434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:35.504979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.505252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.505523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:35.516835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:35.521658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:35.522743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:35.523824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 553/1101] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:35.529058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:35.572038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:35.632250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29b168-0c73-4f84-ab02-8fab85147d35 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:35.670583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:35.671319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.671599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.671865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:35.672542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:35.672844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:35.674199 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:35.682626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 549/1102] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:35.688851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:35.795173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef2ca-ab1d-4b9d-85c0-5e43aac09849 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:35.804928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:35.832455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:35.833089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.833352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.833615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] PATH_INFO: `/v3/users/d9dba895705942aa98ffc58a5b5061bb` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:35.834768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] RBAC: Authorizing `identity:get_user(user_id=d9dba895705942aa98ffc58a5b5061bb)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:35.836251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:35.837834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 554/1103] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:35 2022] GET /identity/v3/users/d9dba895705942aa98ffc58a5b5061bb => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:35.843863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:35.946694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff5a9-689f-47ea-aabd-b437dac9b5e9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:35.948350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:35.986727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:35.987392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:35.987677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:35.987940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:36.064315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:36.065940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:36.165406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 550/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:36.171915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:36.275500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625fe9d-32f6-483b-b45a-5510c0020e7a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:36.310754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:36.311469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:36.311745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:36.312015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:36.313182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:36.314678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6ca50-7da0-41ec-b9ed-72ce347ce823 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:36.316296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 555/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:36 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:36.323187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:36.325422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:36.426984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5531d-6e46-4235-b24d-a2423316be24 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:36.464570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:36.465188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:36.465463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:36.465713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:36.466450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=aa641f9631694d96a7777f7422e0b8d2, user.id=d9dba895705942aa98ffc58a5b5061bb) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:36.466751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:36.468264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc80fb-fd2b-4339-a03a-6f4acd87ca75 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:36.474313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 551/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:36 2022] GET /identity/v3/role_assignments?user.id=d9dba895705942aa98ffc58a5b5061bb&scope.project.id=aa641f9631694d96a7777f7422e0b8d2&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:38.479032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b223d5-3130-4b64-a4a9-cf5056fe733f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:38.479659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b223d5-3130-4b64-a4a9-cf5056fe733f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:38.479659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b223d5-3130-4b64-a4a9-cf5056fe733f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:38.480974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 556/1107] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:38.486658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:38.487086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:38.487238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:38.516185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:38.517426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:38.590558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:38.598869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 552/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:38.622918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b223d5-3130-4b64-a4a9-cf5056fe733f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:38.672267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:38.728697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b223d5-3130-4b64-a4a9-cf5056fe733f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:38.765482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:38.766113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:38.766382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:38.766644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:38.767794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:38.769226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c40b-5a94-48c6-aa01-2b1c46ca590d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:38.770802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 557/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:38.777006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:38.888706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e26c-b5c8-4d1b-8255-3706884a0f08 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:38.925324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:38.925942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:38.926220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:38.926490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:38.927158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:38.928606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281db3c-7ae2-4aea-ba22-9b651489c284 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:38.953284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 553/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:21:38 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:21:40.980349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231d8e-c27e-42eb-8a35-f522d1f8dc0a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:40.980957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231d8e-c27e-42eb-8a35-f522d1f8dc0a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:40.980957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231d8e-c27e-42eb-8a35-f522d1f8dc0a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:40.982197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 558/1111] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:40.987855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:40.988541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:40.988756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:41.007427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:41.008623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:41.057850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:41.079835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 554/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:41.103133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d231d8e-c27e-42eb-8a35-f522d1f8dc0a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:41.212721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d231d8e-c27e-42eb-8a35-f522d1f8dc0a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:41.227371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:41.251143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:41.251715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:41.251991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:41.252264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] PATH_INFO: `/v3/roles/070fb9808a24437b8676aa149373541e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:41.253672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] RBAC: Authorizing `identity:get_role(role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:41.255040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:41.256427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 559/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:41 2022] GET /identity/v3/roles/070fb9808a24437b8676aa149373541e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:41.262705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:41.371702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cadcc-70da-4b0c-a8e3-386735ad39f0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:41.408788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:41.409423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:41.409701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:41.409969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] PATH_INFO: `/v3/users/4e9d4feb25c14c8f8d98200a1af20503` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:41.424096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d4feb25c14c8f8d98200a1af20503)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:41.425565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:41.427659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 555/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:41 2022] GET /identity/v3/users/4e9d4feb25c14c8f8d98200a1af20503 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:41.433238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:41.536587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eae5-5779-4e13-a48a-7fb280551e2a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:41.571895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:41.572525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:41.572802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:41.573063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:41.621318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:41.643239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:41.644725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:41.748555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 560/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:41.754953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:41.812585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:41.876938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465872f-8e95-47c4-959f-b2c6354395ad None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:41.911959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:41.912600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:41.912897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:41.913173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:41.914307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:41.915790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee420b80-27b9-4e65-a922-60db72ffff89 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:41.917456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 556/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:41 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:41.924168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:42.004748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:42.025149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac8b3-8b64-402f-ad32-4ed85b41333c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:42.059618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:42.060235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:42.060506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:42.060800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:42.061613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=aa641f9631694d96a7777f7422e0b8d2, user.id=4e9d4feb25c14c8f8d98200a1af20503) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:42.061918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:42.063474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0651-8efc-474b-9993-7fd8154dc3ec None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:42.069055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 561/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:41 2022] GET /identity/v3/role_assignments?user.id=4e9d4feb25c14c8f8d98200a1af20503&scope.project.id=aa641f9631694d96a7777f7422e0b8d2&role.id=070fb9808a24437b8676aa149373541e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:44.004535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682a08-b3a7-453e-a263-aae7a74f02b4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.005164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682a08-b3a7-453e-a263-aae7a74f02b4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.005164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682a08-b3a7-453e-a263-aae7a74f02b4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.006428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 557/1118] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:44.012038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.012515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.012656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.037798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:44.039021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:44.108746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 562/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:44.131364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682a08-b3a7-453e-a263-aae7a74f02b4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:44.243228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682a08-b3a7-453e-a263-aae7a74f02b4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:44.253134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:44.279949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:44.280490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.280764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.281030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] PATH_INFO: `/v3/roles/070fb9808a24437b8676aa149373541e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.282547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] RBAC: Authorizing `identity:get_role(role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:44.283970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:44.285312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 558/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:44 2022] GET /identity/v3/roles/070fb9808a24437b8676aa149373541e => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:44.291575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:44.378710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:44.409086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df8b08-ae61-4257-bf6a-d0a0755dd689 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:44.446992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:44.447822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.447972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.448202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] PATH_INFO: `/v3/users/4e9d4feb25c14c8f8d98200a1af20503` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.449365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d4feb25c14c8f8d98200a1af20503)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:44.450820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:44.452497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 563/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:44 2022] GET /identity/v3/users/4e9d4feb25c14c8f8d98200a1af20503 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:44.458666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:44.564198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30faa-d068-4d79-8cd9-c496f64b1dee None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:44.600638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:44.601306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.601580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.601846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.603107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:44.604598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9eb4-fd53-41cd-97c8-32d06edd84a9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:44.606244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 559/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:44 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:44.612540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:44.715443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c0ec-a7c9-41c4-b067-7f3cbc3b0c7d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:44.752425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:44.753089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:44.753364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:44.753633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2/users/4e9d4feb25c14c8f8d98200a1af20503/roles/070fb9808a24437b8676aa149373541e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:44.755883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa641f9631694d96a7777f7422e0b8d2, user_id=4e9d4feb25c14c8f8d98200a1af20503, role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:44.757318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824abd9d-e98e-40af-911a-00dd121fc088 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:44.771305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 564/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:21:44 2022] PUT /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2/users/4e9d4feb25c14c8f8d98200a1af20503/roles/070fb9808a24437b8676aa149373541e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:21:46.704690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab86-a23e-4146-9de1-62d5ab6f7667 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:46.705247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab86-a23e-4146-9de1-62d5ab6f7667 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:46.705247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab86-a23e-4146-9de1-62d5ab6f7667 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:46.706462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 560/1124] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:46.712090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:46.712537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:46.712655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:46.719496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:46.734777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:46.735770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:46.806756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 565/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:46.830294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ab86-a23e-4146-9de1-62d5ab6f7667 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:46.880558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:46.943738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ab86-a23e-4146-9de1-62d5ab6f7667 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:46.982887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:46.983516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:46.983787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:46.984054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] PATH_INFO: `/v3/roles/070fb9808a24437b8676aa149373541e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:46.985555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] RBAC: Authorizing `identity:get_role(role_id=070fb9808a24437b8676aa149373541e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:46.986939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:46.988347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 561/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:46 2022] GET /identity/v3/roles/070fb9808a24437b8676aa149373541e => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:46.996240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:47.103243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaed16-3a2f-471b-a23f-e316020a6731 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:47.133508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:47.139239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:47.139897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:47.140174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:47.140449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] PATH_INFO: `/v3/users/4e9d4feb25c14c8f8d98200a1af20503` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:47.141608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] RBAC: Authorizing `identity:get_user(user_id=4e9d4feb25c14c8f8d98200a1af20503)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:47.143044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:47.144680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 566/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:46 2022] GET /identity/v3/users/4e9d4feb25c14c8f8d98200a1af20503 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:47.150975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:47.254442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239c25f-98ac-41fe-ab21-368dad598d54 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:47.267782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:47.290045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:47.290664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:47.290941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:47.291250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:47.361697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:47.363152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:47.469522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 562/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:47.475983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:47.581055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5bbf1-917d-47df-ad96-2976d17e5723 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:47.621111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:47.622018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:47.622328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:47.622755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] PATH_INFO: `/v3/projects/aa641f9631694d96a7777f7422e0b8d2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:47.624466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] RBAC: Authorizing `identity:get_project(project_id=aa641f9631694d96a7777f7422e0b8d2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:47.625901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1fe18-b208-4ea3-81e6-0bbe6af3f9fb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:47.627593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 567/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:47 2022] GET /identity/v3/projects/aa641f9631694d96a7777f7422e0b8d2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:47.633892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:47.649063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:47.738739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64506b5-74b7-4b78-a018-c68308c3d8fd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:47.776054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:47.776668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:47.776945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:47.777210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:47.777949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] RBAC: Adding query filter params (role.id=070fb9808a24437b8676aa149373541e, scope.project.id=aa641f9631694d96a7777f7422e0b8d2, user.id=4e9d4feb25c14c8f8d98200a1af20503) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:47.778258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:47.779736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd8700-c8bc-43c5-ac2e-71187c9c9c73 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:47.785517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 563/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:47 2022] GET /identity/v3/role_assignments?user.id=4e9d4feb25c14c8f8d98200a1af20503&scope.project.id=aa641f9631694d96a7777f7422e0b8d2&role.id=070fb9808a24437b8676aa149373541e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:49.774489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b29909-4d2a-407f-a34a-7c8fd725eac7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:49.775102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b29909-4d2a-407f-a34a-7c8fd725eac7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:49.775102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b29909-4d2a-407f-a34a-7c8fd725eac7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:49.776327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 568/1131] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:49.781721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:49.782159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:49.782249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:49.802168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:49.803486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:49.878499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 564/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:49.901637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b29909-4d2a-407f-a34a-7c8fd725eac7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:49.976769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:50.026987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b29909-4d2a-407f-a34a-7c8fd725eac7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:50.065274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:50.065915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:50.066203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:50.066474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:50.068142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:50.069591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb0793-74f6-4b28-bf20-a37e43dd92df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:50.071226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 569/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:50.077492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:50.085876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:50.180877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804f96-4160-4ada-a9b6-e4a27581e30e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:50.217019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:50.217530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:50.217905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:50.217905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:50.218702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:50.220171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6f132-d00c-4129-8c48-cfeaf710751a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:50.249080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 565/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:21:50 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:52.276737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c78b-b630-4b4c-a5c6-77c1c231ffc3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:52.277343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c78b-b630-4b4c-a5c6-77c1c231ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:52.277343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4c78b-b630-4b4c-a5c6-77c1c231ffc3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:52.278582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 570/1135] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:52.284350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:52.284856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:52.285022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:52.304687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:52.305938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:52.362540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:52.377160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 566/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:52.402324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c78b-b630-4b4c-a5c6-77c1c231ffc3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:52.514826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4c78b-b630-4b4c-a5c6-77c1c231ffc3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:52.550095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:52.550653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:52.550926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:52.551217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:52.552354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:52.553775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a002eb2-d726-485e-a20e-3a3b42b92e7b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:52.555383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 571/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:21:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:52.561561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:52.665130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf593-fbed-4945-9dee-014a1601ef2f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:52.700910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:52.701526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:52.701810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:52.702099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:52.702749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:52.704217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b84321-7da1-4ce9-8974-6df33733207a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:52.728610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 567/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:21:52 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:21:54.740157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843651-70bd-4b17-be27-6912cb2edc87 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:54.740717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843651-70bd-4b17-be27-6912cb2edc87 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:54.740717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843651-70bd-4b17-be27-6912cb2edc87 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:54.741914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 572/1139] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:54.747422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:54.747856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:54.747955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:54.767306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:54.768517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:54.811889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:54.840040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 568/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:54.863184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48843651-70bd-4b17-be27-6912cb2edc87 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:54.867478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:54.966325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48843651-70bd-4b17-be27-6912cb2edc87 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.001548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.002101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.002372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.002636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.013012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:55.017682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:55.018845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:55.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 573/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:55.025155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:55.126727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adc5da-0449-4f6e-837f-3e8c907c61dd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.162344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.162954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.163242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.163528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.164206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:55.164509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:55.165869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:55.174231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 569/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:55.180418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:55.246221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:55.282959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50081e28-0e0d-4f45-9240-0955eb5dd052 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.317801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.318589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.318874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.319142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] PATH_INFO: `/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.333761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] RBAC: Authorizing `identity:get_user(user_id=1cdac998e8a6411bb1c451dbd3bc3fd8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:55.335246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:55.336911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 574/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:55 2022] GET /identity/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:55.343273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:55.378557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:55.447037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f1be-10de-452f-a2f2-fe29789c86b7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.482259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.482866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.483234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.483523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.551109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:55.552517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:55.586654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:55.663328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 570/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:21:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:21:55.669541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:55.771168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce5356-b5b9-46b4-8ee2-205cfaa6e303 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.795260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:55.808861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.809464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.809721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.809990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] PATH_INFO: `/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.811123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] RBAC: Authorizing `identity:get_project(project_id=a59f145f6be34a959e99bfde1f7ca4aa)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:55.812636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08cd0-9555-4554-ae82-ca01c47ff1ea None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:55.814285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 575/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:55 2022] GET /identity/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:21:55.821014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:55.934102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62eaf4-e7ec-445d-9934-a48ed3d0491c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:55.972446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:55.973058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:55.973334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:55.973600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:55.974332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=a59f145f6be34a959e99bfde1f7ca4aa, user.id=1cdac998e8a6411bb1c451dbd3bc3fd8) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:55.974642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:55.976120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255e92e-4aa2-4d11-a1a4-cadcd10f938f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:55.978857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:55.981908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 571/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:21:55 2022] GET /identity/v3/role_assignments?user.id=1cdac998e8a6411bb1c451dbd3bc3fd8&scope.project.id=a59f145f6be34a959e99bfde1f7ca4aa&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:57.942302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41623c5e-fe4d-4ba7-9462-5d7ddc4ca002 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:57.943165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41623c5e-fe4d-4ba7-9462-5d7ddc4ca002 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:57.943165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41623c5e-fe4d-4ba7-9462-5d7ddc4ca002 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:57.945301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 576/1147] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:21:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:21:57.951598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473da4f-3021-4aec-a737-dec553317445 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:57.953534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473da4f-3021-4aec-a737-dec553317445 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:57.953534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473da4f-3021-4aec-a737-dec553317445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:57.976411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f473da4f-3021-4aec-a737-dec553317445 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:21:57.977656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f473da4f-3021-4aec-a737-dec553317445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:21:58.052086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 572/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:21:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:21:58.078229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41623c5e-fe4d-4ba7-9462-5d7ddc4ca002 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:58.187621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41623c5e-fe4d-4ba7-9462-5d7ddc4ca002 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:58.225858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:58.226415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:58.226690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:58.226960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:58.237834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:21:58.242514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:21:58.243591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:21:58.244441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 577/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:21:58.252602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473da4f-3021-4aec-a737-dec553317445 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:58.362476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473da4f-3021-4aec-a737-dec553317445 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:58.393826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:58.400906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:58.401520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:58.401790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:58.402058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:58.402710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:21:58.403005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:58.404405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:58.412807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 573/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:58.421500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:58.474532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:58.530273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c3c7-505a-4988-8f5a-e0f2a2d7e13a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:58.567413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:58.568042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:58.568314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:58.568587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] PATH_INFO: `/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:58.569752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] RBAC: Authorizing `identity:get_user(user_id=1cdac998e8a6411bb1c451dbd3bc3fd8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:58.571185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:58.572815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 578/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:21:58 2022] GET /identity/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:58.578899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:58.686181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e35637-88b1-45e9-b4d8-2e2aef725502 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:58.723829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:58.724457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:58.724737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:58.724969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] PATH_INFO: `/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:58.726229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] RBAC: Authorizing `identity:get_project(project_id=a59f145f6be34a959e99bfde1f7ca4aa)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:58.727698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c1c0-3bd5-4ef4-af94-5e68995af829 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:58.729347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 574/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:21:58 2022] GET /identity/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:21:58.735792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:21:58.841396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa2e5-8640-4aa7-9021-1746e5e2c97c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:21:58.859698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:21:58.879035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:21:58.879730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:21:58.880000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:21:58.880271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] PATH_INFO: `/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa/users/1cdac998e8a6411bb1c451dbd3bc3fd8/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:21:58.882441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a59f145f6be34a959e99bfde1f7ca4aa, user_id=1cdac998e8a6411bb1c451dbd3bc3fd8, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:21:58.883905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece1dd6-44c9-428e-99ee-9f0cc5a02de8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:21:58.904352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 579/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:21:58 2022] PUT /identity/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa/users/1cdac998e8a6411bb1c451dbd3bc3fd8/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:22:00.868814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08aec-b637-4691-998b-59dc6c434063 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:00.869371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08aec-b637-4691-998b-59dc6c434063 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:00.869371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08aec-b637-4691-998b-59dc6c434063 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:00.870730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 575/1154] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:00.876396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:00.876832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:00.876920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:00.895869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:00.897071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:00.964629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 580/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:00.988772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08aec-b637-4691-998b-59dc6c434063 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:01.055215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:01.097877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08aec-b637-4691-998b-59dc6c434063 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:01.133884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:01.134427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:01.134697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:01.134962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:01.145400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:22:01.150033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:22:01.151115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:22:01.152168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 576/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:22:01.157503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:01.262184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cade0f-66a4-4a2b-a44c-04e4a2ec33cf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:01.271699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:01.297644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:01.298292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:01.298567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:01.298834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:01.299537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:01.299839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:01.301208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:01.309552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 581/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:01.315779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:01.424520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4493e-116c-4a47-b3fb-3f9e19c077e6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:01.445881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:01.461013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:01.461656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:01.461928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:01.462193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] PATH_INFO: `/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:01.463364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=1cdac998e8a6411bb1c451dbd3bc3fd8)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:01.464827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:01.466414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 577/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:22:01 2022] GET /identity/v3/users/1cdac998e8a6411bb1c451dbd3bc3fd8 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:01.472665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:01.575036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12243e-45ea-47b5-8e8a-8914106afee7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:01.608473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:01.609073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:01.609344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:01.609605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:01.647023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:01.676173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:01.677530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:01.775571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 582/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:22:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:22:01.782054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:01.888269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3548c-e990-4005-81b8-a3c88ba1a7e6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:01.923807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:01.924447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:01.924722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:01.924993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] PATH_INFO: `/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:01.926160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] RBAC: Authorizing `identity:get_project(project_id=a59f145f6be34a959e99bfde1f7ca4aa)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:01.927694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5af5-0a14-4d34-9687-0adfa113aafa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:01.929261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 578/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:22:01 2022] GET /identity/v3/projects/a59f145f6be34a959e99bfde1f7ca4aa => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:01.936006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:02.003073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:02.036286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38919f1e-5eb9-4596-a172-dd0660e99545 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:02.071866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:02.072489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:02.072762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:02.073032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:02.073771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=a59f145f6be34a959e99bfde1f7ca4aa, user.id=1cdac998e8a6411bb1c451dbd3bc3fd8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:02.074080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:02.075594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460cdce-0c85-4a70-8cff-5378bf7a079f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:02.081794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 583/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:22:01 2022] GET /identity/v3/role_assignments?user.id=1cdac998e8a6411bb1c451dbd3bc3fd8&scope.project.id=a59f145f6be34a959e99bfde1f7ca4aa&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:04.083931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5f5d-8a3a-40fb-a7df-317e0604483e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:04.084502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5f5d-8a3a-40fb-a7df-317e0604483e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:04.084502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e5f5d-8a3a-40fb-a7df-317e0604483e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:04.085815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 579/1162] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:04.091020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:04.091489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:04.091590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:04.112063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:04.113244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:04.187724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 584/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:04.210349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5f5d-8a3a-40fb-a7df-317e0604483e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:04.285813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:04.333396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e5f5d-8a3a-40fb-a7df-317e0604483e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:04.372988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:04.373763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:04.374174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:04.374510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:04.457407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:04.458845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:04.518137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:04.577608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 580/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:22:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:22:04.586358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:04.650623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:04.688554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b4d18-24ff-44b9-bee4-2b946a935072 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:04.731032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:04.731704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:04.731969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:04.732213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:04.739864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:04.741319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f876c4b0-f6b6-4dc5-9fdb-3f3290c5a8fd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:22:04.753006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:22:04.754273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:22:04.755171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 585/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:22:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:22:04.761896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:04.873517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edf62-1d0b-4c23-9b01-14f374c44876 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:04.907897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:04.908431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:04.908708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:04.908974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:04.909617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:04.909895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:04.911284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3156c5-1a29-490a-8222-d75f6bcc499a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:04.918530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 581/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Aug 7 19:22:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:06.887127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7266af-31fb-4588-b43d-3da62dfb04eb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:06.888036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7266af-31fb-4588-b43d-3da62dfb04eb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:06.888036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7266af-31fb-4588-b43d-3da62dfb04eb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:06.890025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 586/1167] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:06.897959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff45-38f8-47f1-ac67-d5339b9ba533 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:06.898408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff45-38f8-47f1-ac67-d5339b9ba533 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:06.898517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff45-38f8-47f1-ac67-d5339b9ba533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:06.917924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0e21ff45-38f8-47f1-ac67-d5339b9ba533 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:06.919112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0e21ff45-38f8-47f1-ac67-d5339b9ba533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:06.934128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:06.991771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 582/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:07.017038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7266af-31fb-4588-b43d-3da62dfb04eb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:07.128934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7266af-31fb-4588-b43d-3da62dfb04eb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:07.152795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:07.167728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:07.168349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:07.168623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:07.168893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:07.169556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:07.170927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4504825-a3d3-4fd1-a3bf-38382cba7a75 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:07.189694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 587/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Sun Aug 7 19:22:07 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:22:09.186880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976292c-d83a-4871-8a39-8647f06ec573 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:09.187522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976292c-d83a-4871-8a39-8647f06ec573 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:09.187522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976292c-d83a-4871-8a39-8647f06ec573 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:09.188861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 583/1170] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:09.194713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:09.195216 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:09.195216 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:09.215743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:09.216930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:09.285800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 588/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:09.309422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976292c-d83a-4871-8a39-8647f06ec573 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:09.414263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976292c-d83a-4871-8a39-8647f06ec573 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:09.453433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:09.454100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:09.454285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:09.454580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] PATH_INFO: `/v3/domains/886bbf52a79144618cbc062f14a4a1b5` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:09.465579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=886bbf52a79144618cbc062f14a4a1b5)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:09.467032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724aed-ebac-4c5e-8b97-27b4037d4056 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:09.468681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 584/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Aug 7 19:22:09 2022] GET /identity/v3/domains/886bbf52a79144618cbc062f14a4a1b5 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:09.475693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:09.582844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdfc53-cc7e-409f-992d-3a6fbb768602 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:09.597739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:09.619330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:09.619946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:09.620220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:09.620485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:09.621125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:09.622557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d8ca-e14b-4c0a-9d03-3a994b5120d9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:09.653336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 589/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:22:09 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:22:11.661258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4eb7-ab9f-48d5-8c9c-4221f75f9cec None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:11.661821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4eb7-ab9f-48d5-8c9c-4221f75f9cec None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:11.661821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4eb7-ab9f-48d5-8c9c-4221f75f9cec None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:11.663187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 585/1174] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:11.668609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:11.669039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:11.669161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:11.689852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:11.690976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:11.761732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 590/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:11.786533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4eb7-ab9f-48d5-8c9c-4221f75f9cec None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:11.800585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:11.901753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4eb7-ab9f-48d5-8c9c-4221f75f9cec None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:11.937499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:11.938126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:11.938395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:11.938657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] PATH_INFO: `/v3/domains/886bbf52a79144618cbc062f14a4a1b5` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:11.939837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=886bbf52a79144618cbc062f14a4a1b5)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:11.941365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf66d7-39b5-4209-aede-f6c08f968956 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:11.943288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 586/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Aug 7 19:22:11 2022] GET /identity/v3/domains/886bbf52a79144618cbc062f14a4a1b5 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:11.949404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:12.047208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:12.054232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0413d9d-a3f7-427a-8281-e404e1fa9d60 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:12.091860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:12.092474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:12.092748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:12.093013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:12.093665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:12.095232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a9e5e-ba42-4079-b8d5-c9d8a298d49e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:12.117099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 591/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:22:11 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:22:14.110469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92583-332f-4822-95d1-46a63a632eab None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.111018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92583-332f-4822-95d1-46a63a632eab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.111400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92583-332f-4822-95d1-46a63a632eab None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.112929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 587/1178] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:14.118556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.119015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.119105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.137923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:14.139151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:14.209411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 592/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:14.232345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92583-332f-4822-95d1-46a63a632eab None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:14.319695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:14.347097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92583-332f-4822-95d1-46a63a632eab None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:14.382625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:14.383168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.383484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.383752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.395840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:22:14.400487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:22:14.402027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:22:14.403334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 588/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:22:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:22:14.408595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:14.491839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:14.512470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c2cc1-a6d8-4347-a880-f9893fdb7408 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:14.550019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:14.550652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.550934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.551280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.551924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:14.552317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:14.553948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:14.563805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 593/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:22:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:14.570294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:14.673413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a127-dd76-453a-9c1f-ce458b4a700e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:14.708722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:14.709361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.709637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.709890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] PATH_INFO: `/v3/users/b4749da991fe4898b9e4df7692148581` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.717895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:14.728087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] RBAC: Authorizing `identity:get_user(user_id=b4749da991fe4898b9e4df7692148581)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:14.730363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:14.733065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 589/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:22:14 2022] GET /identity/v3/users/b4749da991fe4898b9e4df7692148581 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:14.740271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:14.849864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a5b1a-3c22-46de-b840-84f773f0def0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:14.886905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:14.887570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:14.887851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:14.888122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:14.904370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:14.962144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:14.963530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:15.066334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 594/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:22:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:22:15.073016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:15.176773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ee6c-dec8-4969-8df2-e4559df842ba None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:15.210194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:15.210836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:15.211118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:15.211425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] PATH_INFO: `/v3/projects/923b754992db4e43a3bb06466471dba1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:15.212608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] RBAC: Authorizing `identity:get_project(project_id=923b754992db4e43a3bb06466471dba1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:15.213990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d654bd3-6038-46d2-8656-c380b11940ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:15.215693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 590/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:22:15 2022] GET /identity/v3/projects/923b754992db4e43a3bb06466471dba1 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:15.222190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:15.270027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:15.327694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314832a-fc98-46dc-b0f1-cfcc66335df2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:15.363101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:15.363738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:15.364012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:15.364280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:15.365003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=923b754992db4e43a3bb06466471dba1, user.id=b4749da991fe4898b9e4df7692148581) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:15.365305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:15.366739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ed913-c26a-41d0-948d-62eaf7c92c7b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:15.372258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 595/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:22:15 2022] GET /identity/v3/role_assignments?user.id=b4749da991fe4898b9e4df7692148581&scope.project.id=923b754992db4e43a3bb06466471dba1&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:17.326025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5dd3-8b94-4926-81f3-3055dd34c0e1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:17.326607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5dd3-8b94-4926-81f3-3055dd34c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:17.326607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5dd3-8b94-4926-81f3-3055dd34c0e1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:17.327963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 591/1186] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:17.335618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:17.336037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:17.336270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:17.355378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:17.356592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:17.430176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 596/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:22:17.456108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba5dd3-8b94-4926-81f3-3055dd34c0e1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:17.525074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:17.566048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba5dd3-8b94-4926-81f3-3055dd34c0e1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:17.603048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:17.603850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:17.604124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:17.604389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:17.618547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:22:17.623186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:22:17.624328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:22:17.625188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 592/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:22:17.632222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:17.674011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:17.737291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd646c-755f-41f4-887a-f4fd35842ec5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:17.771389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:17.771997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:17.772270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:17.772532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:17.773200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:17.773501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:17.774869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:17.784296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 597/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:17.790573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:17.898973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cace3d-32ac-4383-8d57-34716a116ac8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:17.929171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:17.944425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:17.945100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:17.945490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:17.945773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] PATH_INFO: `/v3/users/b4749da991fe4898b9e4df7692148581` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:17.947067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] RBAC: Authorizing `identity:get_user(user_id=b4749da991fe4898b9e4df7692148581)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:17.948612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:17.950297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 593/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:22:17 2022] GET /identity/v3/users/b4749da991fe4898b9e4df7692148581 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:17.957016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:18.060994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:18.063928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab175e-a108-4416-86d0-7ae1df36a5b8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:18.103007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:18.103680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:18.103959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:18.104231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] PATH_INFO: `/v3/projects/923b754992db4e43a3bb06466471dba1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:18.105370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] RBAC: Authorizing `identity:get_project(project_id=923b754992db4e43a3bb06466471dba1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:18.106809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba3a8-a0c6-48fe-9ef1-5731efb3b116 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:18.108520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 598/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:22:17 2022] GET /identity/v3/projects/923b754992db4e43a3bb06466471dba1 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:18.114774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:18.222524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4ac19-6331-4fe6-9603-b7c5e2c8aa9a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:18.258072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:18.258736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:18.259014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:18.259309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] PATH_INFO: `/v3/projects/923b754992db4e43a3bb06466471dba1/users/b4749da991fe4898b9e4df7692148581/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:18.261303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=923b754992db4e43a3bb06466471dba1, user_id=b4749da991fe4898b9e4df7692148581, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:18.262747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f43fc-c0f9-44be-9694-d54b4b5961f5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:18.278863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 594/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:22:18 2022] PUT /identity/v3/projects/923b754992db4e43a3bb06466471dba1/users/b4749da991fe4898b9e4df7692148581/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:22:20.249777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a504-3c00-4d89-872e-7e7415bd6317 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:20.250381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a504-3c00-4d89-872e-7e7415bd6317 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:20.250381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a504-3c00-4d89-872e-7e7415bd6317 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:20.251726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 599/1193] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:22:20.257119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:20.257572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:20.257688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:20.276871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:22:20.278067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:22:20.326992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:20.350631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 595/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:22:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 19:22:20.383725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a504-3c00-4d89-872e-7e7415bd6317 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:20.501244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a504-3c00-4d89-872e-7e7415bd6317 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:20.536459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:20.537098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:20.537375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:20.537644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:20.548544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:22:20.553245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:22:20.554382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:22:20.555255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 600/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:22:20.560833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:20.664300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869642-153c-476c-91fe-50a662f4b51a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:20.701911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:20.702531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:20.702797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:20.703050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:20.703755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:20.704050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:20.705551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:20.715704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 596/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:20.721900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:20.752686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:20.828057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38f4fb-955d-4a16-871b-6b665ba8af2a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:20.861736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:20.862379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:20.862646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:20.862912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] PATH_INFO: `/v3/users/b4749da991fe4898b9e4df7692148581` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:20.864057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b4749da991fe4898b9e4df7692148581)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:20.865500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:20.867109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 601/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Aug 7 19:22:20 2022] GET /identity/v3/users/b4749da991fe4898b9e4df7692148581 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:20.873211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:20.922381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:20.978669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d739de-dedc-441d-9db3-b4d373fab0f1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:21.013499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:21.014023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:21.014291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:21.014555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:21.083102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:21.084595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:21.129987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:21.187348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 597/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:22:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:22:21.193845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:21.290560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:21.296710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ccbe-b881-46b5-aacf-878e72e3ecd8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:21.330987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:21.331637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:21.331907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:21.332172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] PATH_INFO: `/v3/projects/923b754992db4e43a3bb06466471dba1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:21.333321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] RBAC: Authorizing `identity:get_project(project_id=923b754992db4e43a3bb06466471dba1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:21.334744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6bec-13b0-45d0-8110-76fd69f7e815 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:21.336407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 602/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Aug 7 19:22:21 2022] GET /identity/v3/projects/923b754992db4e43a3bb06466471dba1 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:21.343130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:22:21.448410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985ca0-731a-4830-92e4-65e7a7124cdb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:22:21.483378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:22:21.483987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:22:21.484252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:22:21.484497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:22:21.485249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=923b754992db4e43a3bb06466471dba1, user.id=b4749da991fe4898b9e4df7692148581) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:22:21.485599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:22:21.487034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed92f21-d8c6-4e0a-8013-b6096d9c2181 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:22:21.492936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 598/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:22:21 2022] GET /identity/v3/role_assignments?user.id=b4749da991fe4898b9e4df7692148581&scope.project.id=923b754992db4e43a3bb06466471dba1&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:22:31.326360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=18 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:22:31.490251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:16.881016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b884c8-f65c-4ef2-82f9-14b20cc8f3be None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:16.881602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b884c8-f65c-4ef2-82f9-14b20cc8f3be None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:16.881602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b884c8-f65c-4ef2-82f9-14b20cc8f3be None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:16.883100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 603/1201] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:16.888602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:16.889126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:16.889213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:16.911266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:16.912637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:16.996521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 599/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:17.021321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b884c8-f65c-4ef2-82f9-14b20cc8f3be None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:17.146656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b884c8-f65c-4ef2-82f9-14b20cc8f3be None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:17.185612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:17.186337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:17.186612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:17.186878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:17.199761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:17.201349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:17.217516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:17.223262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:17.224398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:17.224398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:17.224398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:17.224398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 604/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:17.227604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:17.356813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd799bb3-e7a0-4e0f-acc0-2d0a5adb2227 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:17.390103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:17.396914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:17.397683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:17.398127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:17.398438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:17.399097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:17.399430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:17.400914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac57e6-33b5-4736-a336-214aa098103b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:17.415180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 600/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:17.422776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:17.488068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:17.551249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb03e-bafd-40ce-81ef-60f045e78589 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:17.595929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:17.596955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:17.597458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:17.597952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:17.598948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:17.600641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39758fc-e0fc-42e8-9d00-ff4f9735fef7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:17.626729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 605/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Aug 7 19:23:17 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:23:19.770996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1114f-07a8-4f0a-bd37-4fb3e92344c3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:19.771560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1114f-07a8-4f0a-bd37-4fb3e92344c3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:19.771560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1114f-07a8-4f0a-bd37-4fb3e92344c3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:19.772841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 601/1206] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:19.778553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:19.779066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:19.779149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:19.797663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:19.799363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:19.887268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 606/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:19.911000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1114f-07a8-4f0a-bd37-4fb3e92344c3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:20.048117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1114f-07a8-4f0a-bd37-4fb3e92344c3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:20.097481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:20.098608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:20.099167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:20.099849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:20.118029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:20.124635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:20.127436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:20.128379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 602/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:20.135949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:20.196834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:20.317344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e3e0-d1aa-402d-a2ee-fafc7eb8aa02 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:20.403793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:20.404436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:20.404752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:20.405067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:20.406235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:20.406899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:20.408068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:20.418642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 607/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:20.427073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:20.520703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:20.602536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af734bff-8381-4ac8-bef0-d2fdd46ee37b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:20.655857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:20.656657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:20.656939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:20.657267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:20.670369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:20.672438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:20.691789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:20.692882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:20.694206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:20.694206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:20.694206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:20.694954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 603/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:23:20.700996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:20.825248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:20.829158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be88f2-ee84-4641-bfd2-2b0664468ca6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:20.870023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:20.870584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:20.870937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:20.871117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:20.871817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:20.872122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:20.873545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:20.892195 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 608/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:20.901190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:21.030257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003bf34-c8fe-452b-ae87-f2b66560cb4e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:21.032021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:21.070793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:21.071537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:21.071935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:21.072244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:21.085837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:21.087700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:21.103316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:21.104414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:21.105387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 604/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:21.112320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:21.225436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743efe-f5a4-4828-b8e2-0263a5fe7a0a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:21.262329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:21.262998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:21.263235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:21.263513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:21.264254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:21.264572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:21.266087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:21.298225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 609/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:21.303625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:21.410240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e329e5f-ea17-4f3e-9d7a-c533e410de7c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:21.446319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:21.446931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:21.447228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:21.447507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:21.481627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:21.543400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:21.544894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:21.671962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 605/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:23:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:23:21.679727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:21.701394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:21.797338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656e16-836b-4558-bbc3-67616397cadc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:21.835169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:21.836002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:21.836149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:21.836409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:21.847544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:21.849276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:21.864761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:21.866052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:21.867134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:21.867134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:21.867134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:21.867134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 610/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:21.872327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:21.937993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:21.978886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a69fc-c963-4e0e-b065-c833eb9eb9ce None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:22.020114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:22.020738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:22.021012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:22.021273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:22.021923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:22.022229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:22.024170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:22.038228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 606/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:22.045200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:22.140935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:22.176909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82fb64-969e-4c84-95a9-beac6c8c7a75 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:22.223038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:22.223930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:22.224276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:22.224555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:22.234612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:22.236308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:22.248851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:22.252899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:22.254011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 611/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:22.255943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:22.373337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edcb22-05f0-4401-a950-b107d8f97a76 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:22.403085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:22.426064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:22.426064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:22.426064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:22.426064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:22.426894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:22.427323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:22.428798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46825-a178-457e-8cf7-1e8be4dfee59 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:22.445086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 607/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:22.451098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:22.564970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebeed2-6f87-46e1-8958-c472edb3b464 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:22.596046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:22.605152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:22.605943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:22.606472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:22.606843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:22.607824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=a3f7750b5c4740b4bf56933e2c7bbfe5) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:22.608276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:22.610198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bad5-b128-45ca-a80f-0c5414f8731a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:22.623240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 612/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:23:22 2022] GET /identity/v3/role_assignments?user.id=a3f7750b5c4740b4bf56933e2c7bbfe5&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:24.961294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a063a9-adf3-4a72-bb3a-d4e7e5f7f000 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:24.961901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a063a9-adf3-4a72-bb3a-d4e7e5f7f000 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:24.961901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a063a9-adf3-4a72-bb3a-d4e7e5f7f000 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:24.963213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 608/1220] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:24.968510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:24.968975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:24.969088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:24.989049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:24.990355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:25.071422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 613/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:25.099070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a063a9-adf3-4a72-bb3a-d4e7e5f7f000 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:25.222291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a063a9-adf3-4a72-bb3a-d4e7e5f7f000 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:25.266975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:25.267918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:25.268403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:25.268849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:25.282659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:25.288156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:25.289352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:25.290348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 609/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:25.296646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:25.426765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a7b2-4613-4b79-9878-81994dfd3287 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:25.464280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:25.486656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:25.487291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:25.487569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:25.487860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:25.488531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:25.488863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:25.490242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:25.501854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 614/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:25.509065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:25.565465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:25.630148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2688-f20c-474c-a811-3753e42cc52f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:25.671597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:25.672263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:25.672580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:25.672909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:25.685011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:25.686639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:25.702980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:25.704255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:25.705487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:25.705487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:25.705487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:25.711248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 610/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:25.713798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:25.836979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665111c9-20ba-4c8c-a6ab-e2ba717c3cdb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:25.880304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:25.881612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:25.881953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:25.882279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:25.883155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:25.883590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:25.885365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:25.897961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 615/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:25.904045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.018724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:26.027185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e365a0e-6392-4cb1-9216-ac15116a16a1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:26.072543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:26.073307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:26.073580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:26.073873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:26.084833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:26.086517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:26.100724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:26.101994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:26.103691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 611/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:26.108010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.163053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:26.225466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756849c9-052a-4e4f-a6d7-9601755fc03e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:26.267037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:26.267711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:26.267987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:26.268276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:26.269068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:26.269395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:26.270942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:26.289710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 616/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:26.295616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.410506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbb67-3fa0-4204-b3e6-1d836c84762a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:26.446875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:26.447554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:26.447818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:26.448080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:26.458997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:26.460626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:26.474804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:26.475997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:26.476946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:26.476946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:26.476946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:26.476946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 612/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:26.481795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.596423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587599f6-7166-4522-9f62-4576768c1180 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:26.599613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:26.645487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:26.646148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:26.646423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:26.646696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:26.647419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:26.647728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:26.649562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:26.663174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 617/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:26.669998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.680581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:26.786752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2301-346c-40f2-8a16-581d40295d97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:26.827320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:26.828257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:26.828562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:26.828831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:26.837343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:26.838934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:26.851876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:26.853422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:26.854627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 613/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:26.860106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:26.978117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4eec18-431a-46b8-a894-15b002a51d5a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:27.014294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:27.014915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:27.015180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:27.015480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:27.016182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:27.016484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:27.017916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c82005-2186-470b-9ef6-9949a69dbdb8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:27.030166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 618/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:27.037515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:27.111608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:27.152266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd655eb-0d31-43ff-bf0f-79ff73901351 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:27.189533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:27.190477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:27.190749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:27.191017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/a3f7750b5c4740b4bf56933e2c7bbfe5/roles/2468b40faac643ffb55d5de3738cc6de` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:27.208124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=a3f7750b5c4740b4bf56933e2c7bbfe5, role_id=2468b40faac643ffb55d5de3738cc6de)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:27.209945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc0850-b733-4522-bac3-2a12746dff8a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:27.223719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 614/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:23:27 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/a3f7750b5c4740b4bf56933e2c7bbfe5/roles/2468b40faac643ffb55d5de3738cc6de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:23:29.262695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba2cb-e142-420e-b510-81ac70ca1ed4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:29.263266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba2cb-e142-420e-b510-81ac70ca1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:29.263266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba2cb-e142-420e-b510-81ac70ca1ed4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:29.264636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 619/1233] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:23:29.273453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:29.274006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:29.274109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:29.292984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:29.294188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:29.371793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 615/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:29.395605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba2cb-e142-420e-b510-81ac70ca1ed4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:29.425839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:29.516718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba2cb-e142-420e-b510-81ac70ca1ed4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:29.554873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:29.555531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:29.555811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:29.556080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:29.568662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:29.573407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:29.574559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 19:23:29.575683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:29.579366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 620/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Aug 7 19:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:29.581034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:29.629851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:29.689690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2796-ebc8-4401-83b5-a1a6e7c6868c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:29.728418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:29.729053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:29.729335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:29.729606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:29.730290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:29.730591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:29.732016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:29.740608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 616/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Aug 7 19:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:29.746658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:29.832006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:29.850702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411117-b080-4143-95d9-c4dfb17946e1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:29.888144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:29.888793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:29.889119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:29.889376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:29.900282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:29.901858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:29.917146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:29.918313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:29.919772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:29.919772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:29.919772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:29.919772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 621/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:29.924546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:30.027875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c027-646c-4c79-aac5-d86bc1a0ae73 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:30.038377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:30.068030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:30.069303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:30.069580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:30.069846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:30.070508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:30.070817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:30.072260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:30.085648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 617/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:30.091546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:30.196658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78447-8096-4519-b1e1-8d13bb898a42 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:30.231918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:30.232577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:30.232924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:30.233198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:30.236077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:30.242005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:30.243915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:30.256352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:30.267422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:30.268428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 622/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:30.269025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:30.382520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f627-d17a-4800-8ba1-5e16aa9080c3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:30.424004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:30.424619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:30.424983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:30.425297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:30.426163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:30.426648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:30.428161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:30.450996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 618/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:30.456067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:30.564186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4057b-b0f1-4453-9b42-a11dd57d199d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:30.598213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:30.598944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:30.599241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:30.599499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:30.669971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:30.677778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:30.679392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:30.785024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 623/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:23:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:23:30.791886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:30.825205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:30.907541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6188bb-11d7-4ee8-8b3b-1586adc2631b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:30.947069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:30.947883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:30.948233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:30.948496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:30.961114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:30.962869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:30.981448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:30.982528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:30.983665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:30.983665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:30.983665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:30.983665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 619/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:23:30.990316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:31.096221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:31.104258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20b24-4761-495f-936a-e5c80fcf350c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:31.144024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:31.144650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:31.144919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:31.145244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:31.145898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:31.146199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:31.147606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:31.160464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 624/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:31.166640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:31.260462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:31.287138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb937-49d2-457c-8e41-c8f34fcd152d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:31.324690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:31.325485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:31.325759 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:31.326027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:31.334077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:31.335557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:31.346967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:31.348020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:31.349088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 620/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:31.356527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:31.472408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3d3a-fd16-4320-81dd-1e0b1a0bf442 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:31.517764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:31.518300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:31.518574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:31.518841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:31.519633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:31.520002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:31.521800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2706a-ac06-4639-bd59-0c0564eaefba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:31.536990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 625/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:31.543662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:31.661111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a055c-47f2-4db3-af57-eab4f9a76d22 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:31.698986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:31.699836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:31.700119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:31.700392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:31.701144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] RBAC: Adding query filter params (role.id=2468b40faac643ffb55d5de3738cc6de, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=a3f7750b5c4740b4bf56933e2c7bbfe5) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:31.701454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:31.702906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf9df-7b10-4ee5-8e32-e1da7d5492b5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:31.709646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 621/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:23:31 2022] GET /identity/v3/role_assignments?user.id=a3f7750b5c4740b4bf56933e2c7bbfe5&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=2468b40faac643ffb55d5de3738cc6de => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:33.905401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e179d-3a46-477e-bf98-312b66bf90bb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:33.905928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e179d-3a46-477e-bf98-312b66bf90bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:33.905928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e179d-3a46-477e-bf98-312b66bf90bb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:33.907407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 626/1247] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:33.915384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fc01-9682-417f-abbd-098726be2181 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:33.915887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fc01-9682-417f-abbd-098726be2181 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:33.915983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fc01-9682-417f-abbd-098726be2181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:33.922784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:33.936833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c281fc01-9682-417f-abbd-098726be2181 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:33.938174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c281fc01-9682-417f-abbd-098726be2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:34.016396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 622/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:34.042096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e179d-3a46-477e-bf98-312b66bf90bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:34.064018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:34.162763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e179d-3a46-477e-bf98-312b66bf90bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:34.204427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:34.205110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:34.205463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:34.205780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:34.217724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:34.222769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:34.224314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:34.225450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:34.229591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 627/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:34.230746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281fc01-9682-417f-abbd-098726be2181 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:34.352349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281fc01-9682-417f-abbd-098726be2181 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:34.386376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:34.392981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:34.393658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:34.394042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:34.394372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:34.395159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:34.395533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:34.397225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:34.405752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 623/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:34.411766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:34.495999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:34.520809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e47e-d30a-4a85-ad1f-89ecb12475db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:34.560556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:34.561502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:34.561895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:34.562227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:34.573949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:34.575671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:34.592400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:34.593779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:34.594686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:34.594686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:34.594686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:34.594686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 628/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:34.601143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:34.715905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c13f2-1103-43d9-9e42-8a90ee78f547 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:34.755128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:34.755802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:34.756092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:34.756353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:34.757024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:34.757327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:34.758719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:34.778690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 624/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:34.780228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:34.897892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778cfe-3cd2-4876-95e2-82f8a2c4f2cc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:34.929644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:34.938246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:34.938948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:34.939242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:34.939516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:34.948366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:34.951178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:34.962201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:34.963549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:34.964778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 629/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:23:34.969627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:35.033561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:35.087727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1acea2-2fe8-4557-8771-2667ba3dfde3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:35.131992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:35.132754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:35.133070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:35.133492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:35.134286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:35.134640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:35.136435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:35.154743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 625/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:35.160748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:35.264983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc914d7-69f5-4cbc-b38c-d6e92a3dfda0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:35.304959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:35.305775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:35.306074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:35.306503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:35.372390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:35.386328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:35.388033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:35.503270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 630/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:23:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:23:35.509748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:35.624325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ca85-1fc8-4e3f-8e70-3f5cf7765c37 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:35.639125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:35.666018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:35.666718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:35.666961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:35.667349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:35.678042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:35.679534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:35.694538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:35.695792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:35.697076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:35.697076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:35.697076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:35.697076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 626/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 19:23:35.701792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:35.807408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:35.823115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cde06-3a31-4da5-9154-c3c245950f02 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:35.864967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:35.865247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:35.865373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:35.865635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:35.866591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:35.867072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:35.868609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:35.881530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 631/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:35.887806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:35.997267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078548a2-0531-40a0-b104-c8e83cc3007d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:36.039781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:36.040507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:36.040853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:36.041202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:36.049996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:36.051604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:36.064207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:36.065631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:36.066980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 627/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:36.073498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:36.189862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164e18-2c8f-4c39-b839-f6d29b6d813c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:36.227770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:36.228385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:36.228658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:36.228922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:36.229613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:36.229910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:36.231356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d970bc-2962-445f-b755-ae5ceb29b339 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:36.243065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 632/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:36.249435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:36.277327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:36.370808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1398b-83e4-4cdb-b1ec-798d41e62e10 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:36.413392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:36.414116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:36.414428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:36.414700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:36.415468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=a3f7750b5c4740b4bf56933e2c7bbfe5) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:36.415796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:36.417395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667dfaa-5479-4766-a52d-b3b592c8776a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:36.424736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 628/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:23:36 2022] GET /identity/v3/role_assignments?user.id=a3f7750b5c4740b4bf56933e2c7bbfe5&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:38.458335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e624b-6c11-42dd-a9bb-4dcc1340937d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:38.458893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e624b-6c11-42dd-a9bb-4dcc1340937d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:38.458893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e624b-6c11-42dd-a9bb-4dcc1340937d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:38.460253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 633/1261] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:38.465724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:38.466194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:38.466293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:38.485216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:38.486419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:38.558481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 629/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:38.581215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e624b-6c11-42dd-a9bb-4dcc1340937d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:38.592959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:38.689793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e624b-6c11-42dd-a9bb-4dcc1340937d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:38.725764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:38.726408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:38.726683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:38.726957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:38.738268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:38.743042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:38.744271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:38.745494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 634/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:38.750466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:38.776746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:38.861848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0452f-fbcf-4910-ba42-e8a4b915ac33 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:38.899436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:38.900047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:38.900321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:38.900586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:38.901254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:38.901551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:38.902920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:38.911486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 630/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:38.918170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:38.992976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:39.028454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e3fd-1376-4f8e-b741-3d3fd4376c06 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.066037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.066747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.067308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.067630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.081006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.082729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:39.103710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:39.104958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:39.106029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:39.106029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:39.106029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:39.106029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 635/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:39.111859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:39.201838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:39.230100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af501c-114d-460d-b155-97780ce0a912 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.265289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.265834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.266107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.266382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.267012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:39.267344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.268708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:39.280462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 631/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:39.286578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:39.394634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a1bc-ac94-44e0-aa38-2abb6d2c96e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.417262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:39.434962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.435635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.435903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.436169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.444612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.446056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:39.457199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:39.458378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:39.459875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 636/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:39.465124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:39.580099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8692ec-106d-4fa8-9de5-8bd3d76d7d17 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.616889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.617509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.617763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.618029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.618757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:39.619055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.620502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:39.629208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:39.643395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 632/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:39.649615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:39.752443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca613a-f198-41bb-9d2e-f2b44a03cbf1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.789039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.789696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.789951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.790220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.801077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.802506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:39.817077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:39.818253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:39.820126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:39.820126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:39.820126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:39.820126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 637/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:39.827687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:39.941274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcaa2-3f7b-47e7-90bb-0df676a82560 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:39.979099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:39.980003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:39.980308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:39.980631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:39.981563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:39.981923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:39.983875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:40.001171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 633/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:40.007276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:40.040079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:40.122347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b5bf-876a-4709-a74c-a78192040993 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:40.157172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:40.157803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:40.158089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:40.158354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:40.165186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:40.166636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:40.178033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:40.179149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:40.180179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 638/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:40.185241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:40.248190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:40.292156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9483e-d3e4-4a99-b1d1-358c0af63dd3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:40.328443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:40.329044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:40.329317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:40.329578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:40.330259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:40.330566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:40.332024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927517-9ea8-4ddf-b986-202b77e17bd1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:40.344706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 634/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:40.351770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:40.451639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:40.461962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9b30-db64-4cf2-853f-f85de27cc105 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:40.498807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:40.499436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:40.499713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:40.499981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] PATH_INFO: `/v3/projects/88cbce51151848439e096043928ffb3b/users/a3f7750b5c4740b4bf56933e2c7bbfe5/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:40.502314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cbce51151848439e096043928ffb3b, user_id=a3f7750b5c4740b4bf56933e2c7bbfe5, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:40.503827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658119b-9d01-4b7f-94f0-ec1c07cce440 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:40.519591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 639/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Aug 7 19:23:40 2022] PUT /identity/v3/projects/88cbce51151848439e096043928ffb3b/users/a3f7750b5c4740b4bf56933e2c7bbfe5/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:23:42.508882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b956-840a-4eb3-a618-2de869162006 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:42.509458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b956-840a-4eb3-a618-2de869162006 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:42.509458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b956-840a-4eb3-a618-2de869162006 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:42.510778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 635/1274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:42.517333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:42.518033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:42.518222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:42.540051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:42.541269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:42.613838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 640/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:42.648891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b956-840a-4eb3-a618-2de869162006 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:42.777839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b956-840a-4eb3-a618-2de869162006 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:42.800603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:42.820596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:42.821240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:42.821516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:42.821782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:42.832769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 19:23:42.837437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:42.838555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:42.839466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 636/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Aug 7 19:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:42.845111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:42.928707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:42.950039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6ef70-9bc4-4b4e-a92a-2dad604f0675 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:42.986229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:42.986830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:42.987103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:42.987392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:42.988048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:42.988348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:42.989713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:42.997718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 641/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Aug 7 19:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:43.006347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:43.110978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa562d-3bbc-493f-98f7-e83c9eb27f96 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:43.145963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:43.146599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:43.146875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:43.147140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:43.157373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:43.158840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:43.174630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:43.175791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:43.176996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:43.176996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:43.176996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:43.176996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 637/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:43.181994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:43.301855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b412-edd4-4782-bbc9-56daa4571674 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:43.336554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:43.337164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:43.337435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:43.337702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:43.338345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:43.338643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:43.340048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:43.351538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 642/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:43.361057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:43.395590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:43.469168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630947de-6378-4bcb-839a-1e876e654b36 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:43.503505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:43.504137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:43.504409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:43.504675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:43.512730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:43.514178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 19:23:43.525684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:43.526815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:43.528167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 638/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:43.533767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:43.538580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:43.641064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e787cc-d63c-44a9-a5c0-5b56bdcf135e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:43.674214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:43.674819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:43.675081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:43.675396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:43.676113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:43.676415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:43.677874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:43.694547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 643/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Aug 7 19:23:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:43.704229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:43.806717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:43.817453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6604-f04b-4e1a-9e61-d177b7351245 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:43.855907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:43.856730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:43.857093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:43.857417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:43.932828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:43.934291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.024580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:44.041975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 639/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Aug 7 19:23:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 19:23:44.051545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:44.126589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:44.164310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715180-a93e-410f-b592-71d0429c1ed9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:44.199139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:44.199718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:44.199990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:44.200256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:44.212368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:44.214057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 19:23:44.232977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:44.234198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 19:23:44.235562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 19:23:44.235562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 19:23:44.235562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:44.235562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 644/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:44.240618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:44.344215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b8388-b65f-4d0e-a89d-950c93eaa552 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:44.381383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:44.381996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:44.382268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:44.382529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:44.383168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:44.383502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:44.384875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.396572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 640/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Aug 7 19:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:44.402530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:44.523988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c34e4-7194-4e14-ab73-193f20609722 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:44.538728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:44.570587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:44.571231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:44.571517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:44.571778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:44.579222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:44.580678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 19:23:44.591948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:44.593010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Aug 07 19:23:44.594262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 645/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Aug 7 19:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:44.601517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:44.654454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:44.714062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977804-940d-43ae-b7c1-74091ab98260 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:44.753953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:44.754566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:44.754838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:44.755110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:44.755945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:44.756245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:44.757686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787f44e-df42-4430-a5d8-c597373f42bb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.771770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 641/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Aug 7 19:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:44.778883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:44.890938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd1a8-ce82-4d4a-a174-11a1fba118db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:44.925677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:44.926278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:44.926551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:44.926906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:44.927671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] RBAC: Adding query filter params (role.id=bdc7a74d6e874a13b6f1e0e814b94f46, scope.project.id=88cbce51151848439e096043928ffb3b, user.id=a3f7750b5c4740b4bf56933e2c7bbfe5) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:44.927979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:44.929396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8c073-da6a-4786-8276-e7bd95ed45ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:44.935393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 646/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Aug 7 19:23:44 2022] GET /identity/v3/role_assignments?user.id=a3f7750b5c4740b4bf56933e2c7bbfe5&scope.project.id=88cbce51151848439e096043928ffb3b&role.id=bdc7a74d6e874a13b6f1e0e814b94f46 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:46.900875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dc41a-5bfd-4947-97c9-a25e9bbfc70f None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:46.901429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dc41a-5bfd-4947-97c9-a25e9bbfc70f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:46.901429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dc41a-5bfd-4947-97c9-a25e9bbfc70f None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:46.902654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 642/1288] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:46.908884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:46.909604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:46.909704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:46.936098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:46.937639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:46.971576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:47.018169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 647/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:47.040315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dc41a-5bfd-4947-97c9-a25e9bbfc70f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:47.159453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dc41a-5bfd-4947-97c9-a25e9bbfc70f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:47.171499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:47.197002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:47.197638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:47.197916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:47.198184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:47.198774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:47.200228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:47.209092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:47.210208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:47.211346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 643/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:23:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:47.217161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:47.320641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b146-1f54-4dee-b0c8-c0ad5d3ae8c9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:47.366261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:47.366861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:47.367133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:47.367431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:47.368063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:47.368360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:47.369725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb45e-985d-4fde-8c82-565dc7a6a677 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:47.374991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 648/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 19:23:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:47.381120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:47.487566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed092-2ae1-4fd9-be5f-cd8cd9497e6a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:47.531627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:47.532234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:47.532511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:47.532785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:47.533419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:47.533723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:47.535095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b86d-2a03-4503-bb82-11d2b05b31cb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:47.539949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 644/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 19:23:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:49.519391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426d51-0f72-4996-979a-72f858c529e7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:49.520302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426d51-0f72-4996-979a-72f858c529e7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:49.520302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426d51-0f72-4996-979a-72f858c529e7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:49.522465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 649/1293] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:49.531437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d32b-a253-43af-b24e-f028d00efcac None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:49.532095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d32b-a253-43af-b24e-f028d00efcac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:49.532399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d32b-a253-43af-b24e-f028d00efcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:49.554368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5d69d32b-a253-43af-b24e-f028d00efcac None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:49.555613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5d69d32b-a253-43af-b24e-f028d00efcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:49.589227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:49.635075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 645/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:49.658228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426d51-0f72-4996-979a-72f858c529e7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:49.702480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:49.774521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426d51-0f72-4996-979a-72f858c529e7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:49.812570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:49.813170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:49.813442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:49.813708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:49.814345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:49.815731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1a45c-d1ab-4848-b5b7-1b243fac5644 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:49.836613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 650/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Aug 7 19:23:49 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:23:51.853922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ea50-d890-4437-b066-8dcdcd042f13 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:51.854768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ea50-d890-4437-b066-8dcdcd042f13 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:51.854768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ea50-d890-4437-b066-8dcdcd042f13 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:51.856834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 646/1296] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:51.863025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:51.863867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:51.864029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:51.889344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:51.890554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:51.971539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 651/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:51.994079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ea50-d890-4437-b066-8dcdcd042f13 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:52.118755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ea50-d890-4437-b066-8dcdcd042f13 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:52.158923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:52.159608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:52.159884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:52.160151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:52.160739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:52.162132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:52.170715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:52.171877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:52.173071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 647/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:23:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:52.178203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:52.197413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:52.282870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2903d-f215-43d8-98f1-38ff17daaeb8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:52.318964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:52.319619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:52.319894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:52.320160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:52.320786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:52.321086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:52.322452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:52.327648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 652/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 19:23:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:52.333906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:52.369263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:52.446487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767d3c-056d-47b4-9948-5cfeeb22de66 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:52.480913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:52.481521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:52.481793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:52.482058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:52.482765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] RBAC: Adding query filter params (interface=public, service_id=61a87acbfb304ebdaf1494476bacfdb3, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:52.483072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:52.484478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13e37-fc76-4dcb-b4be-85a4b14cc8a5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:52.489616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 648/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Aug 7 19:23:52 2022] GET /identity/v3/endpoints?service_id=61a87acbfb304ebdaf1494476bacfdb3&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:23:52.498043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:52.585971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:52.612236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477d439-9554-48a6-b47c-7c7e16d9f653 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:52.649134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:52.649667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:52.649947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:52.650209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:52.650931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:52.652324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8046a-1068-471e-be89-58a2e5df9223 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:52.659486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 653/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Aug 7 19:23:52 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:23:54.651902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a928e7-1d8b-4487-a034-bf8e25ef9039 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:54.652466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a928e7-1d8b-4487-a034-bf8e25ef9039 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:54.652466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a928e7-1d8b-4487-a034-bf8e25ef9039 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:54.653832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 649/1302] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:23:54.660115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:54.660921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:54.660921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:54.686817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:23:54.687972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:23:54.764991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 654/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:23:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 19:23:54.796438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a928e7-1d8b-4487-a034-bf8e25ef9039 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:54.907049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:54.916224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a928e7-1d8b-4487-a034-bf8e25ef9039 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:54.955705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:54.956262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:54.956539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:54.956816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:54.957405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:54.958782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 19:23:54.968576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 19:23:54.969714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: ERROR keystone.server.flask.application Aug 07 19:23:54.970995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 650/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Aug 7 19:23:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 19:23:54.976647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:55.055985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:23:55.082458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730da3d-4516-4aa0-8c5e-58f2c2924ac2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:55.123407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:55.124024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:55.124298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:55.124566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:55.125204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:23:55.125505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:55.126878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c0c4d-2d82-4984-8438-958b1996e3e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:55.132577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 655/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Aug 7 19:23:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:23:55.142204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:23:55.253720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030a90-0838-4de3-ab9f-2c601d19e35b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:23:55.289648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:23:55.290307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:23:55.290616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:23:55.290804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:23:55.291522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:23:55.292896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1db2-e42a-4bcb-be0e-5672cf65a0d6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:23:55.317736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 651/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:23:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:24:05.129145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=30 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:05.312748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:59.143078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3769-e95c-4388-af9d-93f3b3aad8e7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:24:59.144020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3769-e95c-4388-af9d-93f3b3aad8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:24:59.144020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3769-e95c-4388-af9d-93f3b3aad8e7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:24:59.152287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 656/1307] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:24:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:24:59.153665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb670e9-cdc1-47cf-8127-68577cbba4b1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:24:59.154367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb670e9-cdc1-47cf-8127-68577cbba4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:24:59.154367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb670e9-cdc1-47cf-8127-68577cbba4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:24:59.230819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6bb670e9-cdc1-47cf-8127-68577cbba4b1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:24:59.232081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6bb670e9-cdc1-47cf-8127-68577cbba4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:24:59.492271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 652/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:24:59.580058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:24:59.580340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:24:59.580678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:24:59.582165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 657/1309] 10.222.0.15 () {54 vars in 965 bytes} [Sun Aug 7 19:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:24:59.590203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b223b-9118-4f0f-ad2a-109d8e088fff None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:24:59.591223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b223b-9118-4f0f-ad2a-109d8e088fff None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:24:59.591862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b223b-9118-4f0f-ad2a-109d8e088fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:24:59.768774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1a7b223b-9118-4f0f-ad2a-109d8e088fff None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:24:59.770011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a7b223b-9118-4f0f-ad2a-109d8e088fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:24:59.792765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:24:59.855161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 653/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Aug 7 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:24:59.862805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:24:59.864592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:24:59.982274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb541-5f2a-4b50-a297-64e9969c5881 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:00.058625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:00.059237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:00.059534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:00.059786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:00.061393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:00.118574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:00.182167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:00.184274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593215-2949-4350-8d66-083e6fe2f81e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:00.210306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 658/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:02.468118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:02.468753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:02.468753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:02.470256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 654/1312] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:02.476349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa818-a161-4b6c-8349-b3ae1ea681c2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:02.476923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa818-a161-4b6c-8349-b3ae1ea681c2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:02.476923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa818-a161-4b6c-8349-b3ae1ea681c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:02.566961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d5afa818-a161-4b6c-8349-b3ae1ea681c2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:02.568227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d5afa818-a161-4b6c-8349-b3ae1ea681c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:02.670076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 659/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:02.708612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:02.710215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:02.822778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae323-0f72-4ef0-8d22-84d234206091 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:02.899254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:02.902883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:02.902883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:02.902883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:02.902883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:02.905251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:03.021255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:03.022605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe1b23-9d92-4f05-ac93-ecd0c1dc89d1 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:03.041385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 655/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:05.376559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:05.377125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:05.377125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:05.378674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 660/1315] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:05.384459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2279ed-0938-411c-be9e-6819b4462460 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:05.384873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2279ed-0938-411c-be9e-6819b4462460 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:05.385148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2279ed-0938-411c-be9e-6819b4462460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:05.459317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bd2279ed-0938-411c-be9e-6819b4462460 None None] MFA Rules not processed for user `2299e2d24b15412c94b8944dc0ab1c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:05.460569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bd2279ed-0938-411c-be9e-6819b4462460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:05.518820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:05.566071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 656/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:05.610923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:05.612574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:05.622773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:05.724458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207aa6-c8bb-4e5c-801e-e2f6eac9f0db None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:05.800588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:05.801196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:05.801468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:05.801732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:05.803381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:05.867085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:05.919989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:05.921348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a39b5e-e341-44c8-9df2-c91e2167df88 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:05.939480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 661/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:08.528321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:08.528932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:08.528932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:08.530196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 657/1318] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:08.535538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862ea8-8813-40ec-8a3b-3a32474e0a10 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:08.536033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862ea8-8813-40ec-8a3b-3a32474e0a10 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:08.536193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862ea8-8813-40ec-8a3b-3a32474e0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:08.608816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c8862ea8-8813-40ec-8a3b-3a32474e0a10 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:08.610106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8862ea8-8813-40ec-8a3b-3a32474e0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:08.711439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 662/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:08.750635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:08.752273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:08.870161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0dbb4-a6bc-49a8-9b07-396a218d45ce None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:08.946232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:08.946849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:08.947125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:08.947433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:08.949082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:08.956802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:09.064080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:09.065427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed92d9-7b14-4ecb-9f47-ea90531518e9 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:09.085548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 658/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:11.808771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81039923-fd47-4d05-8982-a7f8fe29804d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:11.809408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81039923-fd47-4d05-8982-a7f8fe29804d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:11.809408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81039923-fd47-4d05-8982-a7f8fe29804d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:11.810669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 663/1321] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:11.816926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e7-edc3-4bbd-8279-7972f7dc5964 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:11.817527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e7-edc3-4bbd-8279-7972f7dc5964 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:11.817527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e7-edc3-4bbd-8279-7972f7dc5964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:11.903402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0a81f2e7-edc3-4bbd-8279-7972f7dc5964 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:11.904794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0a81f2e7-edc3-4bbd-8279-7972f7dc5964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:11.980622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:12.030942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 659/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:12.083781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:12.084092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:12.084424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:12.086732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 664/1323] 10.222.0.15 () {54 vars in 965 bytes} [Sun Aug 7 19:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:12.095329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba34d5-22b6-485a-9305-e29cee2dd3be None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:12.095614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba34d5-22b6-485a-9305-e29cee2dd3be None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:12.095875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba34d5-22b6-485a-9305-e29cee2dd3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:12.193536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8eba34d5-22b6-485a-9305-e29cee2dd3be None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:12.194882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8eba34d5-22b6-485a-9305-e29cee2dd3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:12.293244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 660/1324] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Aug 7 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:12.303828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:12.305417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:12.326631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:12.431375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ea36a-5805-43b8-ae2e-17d00974317c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:12.508753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:12.509281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:12.509562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:12.509827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:12.511482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:12.588995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:12.628230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:12.629784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331c8b-3dee-40a6-883c-b48fe26e0537 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:12.648443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 665/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:14.956298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:14.956890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:14.956890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:14.958385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 661/1326] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:14.966389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192b8d-23a6-477e-bde9-337db52ee386 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:14.967282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192b8d-23a6-477e-bde9-337db52ee386 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:14.967282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192b8d-23a6-477e-bde9-337db52ee386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:15.044437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d192b8d-23a6-477e-bde9-337db52ee386 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:15.045747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d192b8d-23a6-477e-bde9-337db52ee386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:15.163013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 666/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:25:15.202316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:15.204256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:15.293040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:15.348428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c00b8-24d2-4420-a246-dd3562888606 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:15.442480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:15.443256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:15.443638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:15.444007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:15.446436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:15.581269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:15.583897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:15.585482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e3bf1-4502-40be-9033-55b9ddc229bf service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:15.606530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 662/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:17.698195 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:17.698997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:17.698997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:17.700174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 667/1329] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:25:17.706387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722de2-6ad9-4780-8393-682b2d9f3eac None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:17.707044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722de2-6ad9-4780-8393-682b2d9f3eac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:17.707044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722de2-6ad9-4780-8393-682b2d9f3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:17.828042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-95722de2-6ad9-4780-8393-682b2d9f3eac None None] MFA Rules not processed for user `2299e2d24b15412c94b8944dc0ab1c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:17.830138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-95722de2-6ad9-4780-8393-682b2d9f3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:18.007776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 663/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:18.047144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:18.048782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:18.084643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:18.185672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a812-06d7-40fc-b87c-eb65c2f0403f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:18.281121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:18.281660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:18.281937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:18.282308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:18.284081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:18.376277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:18.412708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:18.414181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bf6f-7713-43a1-89f9-d916faa6be7a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:18.436174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 668/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:20.908108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:20.908664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:20.908664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:20.910151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 664/1332] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:20.915763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8a0-ba20-42d9-a6e0-69325d93f01e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:20.916268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8a0-ba20-42d9-a6e0-69325d93f01e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:20.916881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c8a0-ba20-42d9-a6e0-69325d93f01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:20.985260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0559c8a0-ba20-42d9-a6e0-69325d93f01e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:20.988586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0559c8a0-ba20-42d9-a6e0-69325d93f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:21.119098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 669/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:21.156005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:21.157574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:21.236434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:21.276317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828bb4-cfe3-49c8-a800-09cf83eea374 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:21.353570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:21.354189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:21.354464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:21.354734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:21.356400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:21.471823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:21.473269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32bb3f-bae2-4bb7-9448-27ef7da84962 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:21.484303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:21.494402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 665/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:23.519821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:23.520448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:23.520448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:23.521758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 670/1335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:23.527269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f927-a2b0-4c45-8ae0-f96ccd114d80 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:23.527709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f927-a2b0-4c45-8ae0-f96ccd114d80 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:23.527823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f927-a2b0-4c45-8ae0-f96ccd114d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:23.596112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-82e1f927-a2b0-4c45-8ae0-f96ccd114d80 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:23.597347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-82e1f927-a2b0-4c45-8ae0-f96ccd114d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:23.702595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 666/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:23.742308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:23.744069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:23.786995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:23.853651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61489-9814-4f65-af1f-54b06c2b4e22 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:23.928326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:23.928936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:23.929209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:23.929474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:23.931118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:24.015859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:24.044453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:24.045906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293817dd-a114-4e68-94f9-6983edeb4eac service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:24.064564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 671/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:26.588044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:26.588607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:26.588607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:26.589887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 667/1338] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:26.596373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a6c0-3dba-419c-8872-f6cfef7df519 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:26.596896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a6c0-3dba-419c-8872-f6cfef7df519 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:26.597222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a6c0-3dba-419c-8872-f6cfef7df519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:26.671272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fe10a6c0-3dba-419c-8872-f6cfef7df519 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:26.672555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe10a6c0-3dba-419c-8872-f6cfef7df519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:26.772920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 672/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:26.809710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:26.811351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:26.891960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:26.921049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0595d0-b867-4afb-9203-3fbcc671112f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:26.997224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:26.997905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:26.998176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:26.998414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:27.000094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:27.121632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:27.123009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b627d4-4986-47fe-8ecb-9ed818db4212 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:27.141424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 668/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:31.264779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:31.265356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:31.265356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:31.267020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 673/1341] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:31.273185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2145-5126-43dd-b3fc-2b9f1a861576 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:31.274270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2145-5126-43dd-b3fc-2b9f1a861576 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:31.274590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2145-5126-43dd-b3fc-2b9f1a861576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:31.282836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:31.350154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b5ee2145-5126-43dd-b3fc-2b9f1a861576 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:31.351468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b5ee2145-5126-43dd-b3fc-2b9f1a861576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:31.465955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 669/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:31.505120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:31.506685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:31.555383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:31.612432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd315b-68c5-4c44-8669-6b2b3bcd632b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:31.687858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:31.688472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:31.688741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:31.689002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:31.690609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:31.794289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:31.811147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:31.812542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625006e3-856c-4fcd-bcb1-9ad28f680af0 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:31.832204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 674/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:25:34.496786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:34.497364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:34.497364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:34.498655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 670/1344] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:34.504202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0caed-94b1-46a0-86f9-b6aef7f98f21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:34.504650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0caed-94b1-46a0-86f9-b6aef7f98f21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:34.504744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0caed-94b1-46a0-86f9-b6aef7f98f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:34.581009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7be0caed-94b1-46a0-86f9-b6aef7f98f21 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:34.582334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7be0caed-94b1-46a0-86f9-b6aef7f98f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:34.681760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 675/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:25:34.720639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:34.722308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:34.818539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:34.838159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69aa7-c9fb-4d8a-be71-3a2f91885631 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:34.914831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:34.915481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:34.915743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:34.916017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:34.917613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:35.030374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:35.031771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9b422-41e3-4e3e-a6e4-e63a85beca6b service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:35.050930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 671/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:39.364118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:39.364699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:39.364699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:39.366457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 676/1347] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:39.372095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5609-8fa5-4422-93e9-a33a7474f132 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:39.372616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5609-8fa5-4422-93e9-a33a7474f132 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:39.372753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5609-8fa5-4422-93e9-a33a7474f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:39.389192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:39.451421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1e8a5609-8fa5-4422-93e9-a33a7474f132 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:39.452668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1e8a5609-8fa5-4422-93e9-a33a7474f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:39.559390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 672/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:39.597914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:39.599576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:39.662238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:39.716406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97723-939f-4fce-900f-b52037d13cac None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:39.796812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:39.797453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:39.797718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:39.797986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:39.799716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:39.911979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:39.916206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:39.917758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6596d-57ab-4567-9b7a-0ce00e555ea4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:39.942501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 677/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:25:45.063238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceaf20-568e-4b8e-9b86-a12ec922dae1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:45.063238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceaf20-568e-4b8e-9b86-a12ec922dae1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:45.063238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceaf20-568e-4b8e-9b86-a12ec922dae1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:45.077384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 673/1350] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:25:45 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:45.084595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce861-29d1-4daf-b8d3-0d0e3807864b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:45.086022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce861-29d1-4daf-b8d3-0d0e3807864b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:45.086461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce861-29d1-4daf-b8d3-0d0e3807864b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:45.185699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3bcce861-29d1-4daf-b8d3-0d0e3807864b None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:45.187426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3bcce861-29d1-4daf-b8d3-0d0e3807864b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:45.390080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 678/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:25:49.327817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b8f2a-3ba4-407c-a7ff-028fe47787a7 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:49.328701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b8f2a-3ba4-407c-a7ff-028fe47787a7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:49.329167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b8f2a-3ba4-407c-a7ff-028fe47787a7 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:49.330679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 674/1352] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:49.336321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266148b3-1522-4497-89a1-af41bd9907bf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:49.336848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266148b3-1522-4497-89a1-af41bd9907bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:49.337174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266148b3-1522-4497-89a1-af41bd9907bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:49.399237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:49.424555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-266148b3-1522-4497-89a1-af41bd9907bf None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:49.425818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-266148b3-1522-4497-89a1-af41bd9907bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:49.553462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 679/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:49.558282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=59 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:51.574492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c03c3-66df-4d69-8b97-1bc6ad1f4459 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:51.575433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c03c3-66df-4d69-8b97-1bc6ad1f4459 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:51.575433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c03c3-66df-4d69-8b97-1bc6ad1f4459 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:51.576457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 675/1354] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:51.582454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51bfb-48fe-4b92-9775-2762fcf46c03 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:51.583072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51bfb-48fe-4b92-9775-2762fcf46c03 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:51.583072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51bfb-48fe-4b92-9775-2762fcf46c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:51.672080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69d51bfb-48fe-4b92-9775-2762fcf46c03 None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:51.673373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69d51bfb-48fe-4b92-9775-2762fcf46c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:51.722447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:51.794305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 680/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:54.885306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce307-22c6-450b-acce-3d03686e32f9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:54.885927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce307-22c6-450b-acce-3d03686e32f9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:54.885927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ce307-22c6-450b-acce-3d03686e32f9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:54.887289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 676/1356] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:54.893310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474274-519b-4658-ad3b-8553d375c5e0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:54.893879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474274-519b-4658-ad3b-8553d375c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:54.893879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474274-519b-4658-ad3b-8553d375c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:54.977751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fd474274-519b-4658-ad3b-8553d375c5e0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:54.978965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd474274-519b-4658-ad3b-8553d375c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:55.104282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 681/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:25:55.161126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:55.161396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:55.162444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:55.164815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 677/1358] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 19:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:55.173858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b82fb-3cdf-4fbc-91f3-8ca3a15db84d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:55.174312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b82fb-3cdf-4fbc-91f3-8ca3a15db84d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:55.174794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b82fb-3cdf-4fbc-91f3-8ca3a15db84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:55.199139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:55.305173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-088b82fb-3cdf-4fbc-91f3-8ca3a15db84d None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:55.306478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-088b82fb-3cdf-4fbc-91f3-8ca3a15db84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:55.535584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 682/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:55.539004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:55.540755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:55.733308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239ade-a8d1-4cb9-9b41-77ec28c1976a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:55.836883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:55.910260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:55.911450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:55.911651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:55.911961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:55.914034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:56.027564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:56.029228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f8fe4-714c-420b-af5e-100b0d6e4930 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:25:56.052527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 678/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:25:58.972732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:58.972732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:58.972732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:58.978771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 683/1361] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:25:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:25:58.981809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffca36-6b83-4143-b2ed-d0863179be5e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:58.983585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffca36-6b83-4143-b2ed-d0863179be5e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:58.984427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffca36-6b83-4143-b2ed-d0863179be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:59.115116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-31ffca36-6b83-4143-b2ed-d0863179be5e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:25:59.117016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-31ffca36-6b83-4143-b2ed-d0863179be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:59.169113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:59.257821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 679/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:25:59.311921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:25:59.313614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:59.401483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:59.553280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a1a09-7c8b-4aca-8c1c-9be26a4757fa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:25:59.791422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:25:59.792428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:25:59.792887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:25:59.793336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:25:59.796403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:25:59.843954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:25:59.977939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:25:59.979950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d699-ca45-4682-a336-e88d46c82319 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:00.005049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 684/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:02.825091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113625-8435-472c-8e34-ef7580381a2e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:02.825998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113625-8435-472c-8e34-ef7580381a2e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:02.826288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113625-8435-472c-8e34-ef7580381a2e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:02.828488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 680/1364] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:02.836133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2689-5c40-4d95-b5b9-3822cc594451 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:02.836754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2689-5c40-4d95-b5b9-3822cc594451 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:02.837065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2689-5c40-4d95-b5b9-3822cc594451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:02.951504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-55dd2689-5c40-4d95-b5b9-3822cc594451 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:02.953690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55dd2689-5c40-4d95-b5b9-3822cc594451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:03.156435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:03.161412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 685/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:03.210308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:03.210574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:03.210845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:03.212486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 681/1366] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 19:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:03.222511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1de8-6b83-4053-9dee-baef6b116c46 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:03.223000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1de8-6b83-4053-9dee-baef6b116c46 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:03.223504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1de8-6b83-4053-9dee-baef6b116c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:03.388907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd2d1de8-6b83-4053-9dee-baef6b116c46 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:03.391082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd2d1de8-6b83-4053-9dee-baef6b116c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:03.672219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 686/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:03.686606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:03.688220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:03.894911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b21b9-206f-4ad3-b376-117de00aaf3a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:03.936039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:04.112163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:04.113362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:04.113829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:04.114296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:04.117686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:04.247662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:04.249355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac221f-4dda-4a4d-974f-2e08175900de service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:04.271725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 682/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:26:05.290499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0691-5239-4298-914c-b89e2f5d8c1f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:05.291440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0691-5239-4298-914c-b89e2f5d8c1f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:05.291440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0691-5239-4298-914c-b89e2f5d8c1f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:05.292796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 687/1369] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:05.298810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c26e-0c4c-4e11-b0ba-12e04a6446ef None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:05.299751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c26e-0c4c-4e11-b0ba-12e04a6446ef None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:05.299751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c26e-0c4c-4e11-b0ba-12e04a6446ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:05.345913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:05.418528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1d83c26e-0c4c-4e11-b0ba-12e04a6446ef None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:05.423029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1d83c26e-0c4c-4e11-b0ba-12e04a6446ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:05.575327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 683/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:06.114179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcbd2-bbeb-4425-94ff-35e21b484519 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:06.114688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcbd2-bbeb-4425-94ff-35e21b484519 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:06.115174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbcbd2-bbeb-4425-94ff-35e21b484519 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:06.118089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 688/1371] 10.222.0.15 () {54 vars in 964 bytes} [Sun Aug 7 19:26:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:06.129073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:06.129573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:06.130022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:06.298787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] MFA Rules not processed for user `ad86d22df95d41c4b328c1e6c19381c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:06.301336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:06.405286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:06.435543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25d52-9caa-4fcf-a691-d89419dbd82f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:06.436364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25d52-9caa-4fcf-a691-d89419dbd82f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:06.436364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25d52-9caa-4fcf-a691-d89419dbd82f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:06.439781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 689/1372] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:06.443748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:06.444036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:06.444350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:06.486031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 684/1373] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Aug 7 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:06.498993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:06.511921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb51a-f83f-4e3b-82cf-52c4978d12e9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:06.515381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:06.524969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:06.526370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:06.604255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:06.604885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:06.605184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:06.605498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:06.607144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:06.660240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 690/1374] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:06.696346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:06.697586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:06.774105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:06.776576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07dd0d-db17-4b87-9fe7-00fc7ec5b762 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:06.796700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:06.815373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 685/1375] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:26:06.840957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759816d2-2b10-4d75-828c-5b8e2e5d53af None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:06.874560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:07.106831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:07.107563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:07.108399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:07.108399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:07.111494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:07.340592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:07.343735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46938f3e-aee7-4711-93b3-9cd84c5a666c service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:07.381456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 691/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:09.737815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:09.738562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:09.738562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:09.739993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 686/1377] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:09.746931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c1f7-ff07-4030-aab9-437738d36cb5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:09.747540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c1f7-ff07-4030-aab9-437738d36cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:09.748047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c1f7-ff07-4030-aab9-437738d36cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:09.784977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:09.848323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d185c1f7-ff07-4030-aab9-437738d36cb5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:09.849547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d185c1f7-ff07-4030-aab9-437738d36cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:10.034167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 692/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:10.100586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:10.102392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:10.339187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151425-0f17-4d5d-8796-d3002eb0c1b6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:10.496742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:10.566965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:10.568468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:10.568970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:10.569422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:10.572602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:10.739857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:10.742242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff80a1-0aba-4bfd-b357-7d9ae498c795 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:10.766590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 687/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:26:13.097873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:13.098826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:13.098826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:13.101396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 693/1380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:13.106147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7278-e279-4af2-a5a1-4844c566339c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:13.106739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7278-e279-4af2-a5a1-4844c566339c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:13.106739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7278-e279-4af2-a5a1-4844c566339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:13.186500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-afba7278-e279-4af2-a5a1-4844c566339c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:13.187937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-afba7278-e279-4af2-a5a1-4844c566339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:13.228086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:13.306537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 688/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:13.358048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:13.359673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:13.492578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:13.565789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8087f41-1e1f-48a9-be08-ad06c00795b3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:13.738262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:13.739534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:13.740537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:13.741135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:13.744518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:13.867489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:13.929294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:13.932504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7fb63-ead3-4452-a217-f6c9f45513ed service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:13.974168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 694/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:16.416727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:16.417631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:16.418351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:16.424232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 689/1383] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:16.433192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829daa-d85f-480a-9fc7-aee85ec44740 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:16.433192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829daa-d85f-480a-9fc7-aee85ec44740 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:16.433192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64829daa-d85f-480a-9fc7-aee85ec44740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:16.553477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-64829daa-d85f-480a-9fc7-aee85ec44740 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:16.555486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64829daa-d85f-480a-9fc7-aee85ec44740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:16.796113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 695/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:16.845905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:16.847654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:17.126818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12a5fc-5046-4842-9649-18121ca16054 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:17.167273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:17.327397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:17.328049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:17.328582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:17.328860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:17.330709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:17.494104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:17.497427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e037913-ac1f-4dcc-83d1-d13cdb3a7883 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:17.538143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 690/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:19.993990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:19.994905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:19.994905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:19.996459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 696/1386] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:20.003762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5968-2536-4ddf-bfcb-aa08cd139b73 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:20.004420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5968-2536-4ddf-bfcb-aa08cd139b73 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:20.004851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5968-2536-4ddf-bfcb-aa08cd139b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:20.054440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:20.133848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0bbc5968-2536-4ddf-bfcb-aa08cd139b73 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:20.135768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0bbc5968-2536-4ddf-bfcb-aa08cd139b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:20.295597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 691/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:20.350520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:20.353543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:20.429654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:20.610742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2799-537a-45f0-ba35-40af4e6c5781 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:20.784502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:20.787255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:20.788208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:20.788508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:20.789184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:20.791846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:20.925548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:20.927656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa639ce-badf-4370-9457-24c6cdda9833 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:20.974716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 697/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:23.509383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:23.510291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:23.510291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:23.512058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 692/1389] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:23.518388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014c3a-9c8f-4e91-9d7d-e7799d976518 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:23.518997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014c3a-9c8f-4e91-9d7d-e7799d976518 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:23.518997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014c3a-9c8f-4e91-9d7d-e7799d976518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:23.603561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ef014c3a-9c8f-4e91-9d7d-e7799d976518 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:23.605254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ef014c3a-9c8f-4e91-9d7d-e7799d976518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:23.696371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:23.731978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 698/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:23.780656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:23.782358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:23.902412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:23.971164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae32a5-aa13-4dea-8a58-0ca0cac637e6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:24.119482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:24.120132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:24.120403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:24.120670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:24.122692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:24.206156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:24.241483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:24.243069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4147f-c144-4d12-a077-00e6c8e6e2cf service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:24.267100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 693/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:24.369085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf1e8-d7a9-4d51-bf22-d1675dc98e59 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:24.369587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf1e8-d7a9-4d51-bf22-d1675dc98e59 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:24.370003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf1e8-d7a9-4d51-bf22-d1675dc98e59 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:24.371764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 699/1392] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:24.380007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b67d8-9585-4e25-815a-2658d8fc2ca2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:24.380646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b67d8-9585-4e25-815a-2658d8fc2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:24.381203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b67d8-9585-4e25-815a-2658d8fc2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:24.500670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e06b67d8-9585-4e25-815a-2658d8fc2ca2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:24.502239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e06b67d8-9585-4e25-815a-2658d8fc2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:24.655744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 694/1393] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:24.727136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:24.728009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:24.728009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:24.730133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 700/1394] 10.222.0.15 () {54 vars in 966 bytes} [Sun Aug 7 19:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:24.737506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07909f-7fd7-4161-984e-2cf56fa9d8f6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:24.737990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07909f-7fd7-4161-984e-2cf56fa9d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:24.738456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07909f-7fd7-4161-984e-2cf56fa9d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:24.813904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:24.862952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ec07909f-7fd7-4161-984e-2cf56fa9d8f6 None None] MFA Rules not processed for user `1daf3ae711f0440ca0b26d214a162074`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:24.864579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ec07909f-7fd7-4161-984e-2cf56fa9d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:24.979852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 695/1395] 10.222.0.15 () {58 vars in 1063 bytes} [Sun Aug 7 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:24.993730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:24.996587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:25.171942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d9e1-9e02-402a-b3f5-11c2d0c591a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:25.291344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:25.292405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:25.292866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:25.293336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:25.296534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:25.360223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:25.521682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:25.525273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f037d-4c9b-4ff9-a16c-120e8813f05e service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:25.562623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 701/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:26.466859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f93c7-1001-43a5-b53a-94743c595a0d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:26.467679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f93c7-1001-43a5-b53a-94743c595a0d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:26.467679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f93c7-1001-43a5-b53a-94743c595a0d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:26.473902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 696/1397] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:26.475693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:26.476360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:26.476360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:26.581120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:26.582635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:26.618175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924ea6-f60c-42b7-b33d-e8345b12cae4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:26.618616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924ea6-f60c-42b7-b33d-e8345b12cae4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:26.619079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23924ea6-f60c-42b7-b33d-e8345b12cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:26.738374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-23924ea6-f60c-42b7-b33d-e8345b12cae4 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:26.740760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-23924ea6-f60c-42b7-b33d-e8345b12cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:26.744702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:26.782575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 702/1398] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:26.850774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:26.852234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:26.871579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:26.882258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 697/1399] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:26.948965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32fd87-2f9e-42db-ab5e-8f87ff3308cb None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:26.949403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32fd87-2f9e-42db-ab5e-8f87ff3308cb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:26.950023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32fd87-2f9e-42db-ab5e-8f87ff3308cb None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:26.952089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 698/1400] 10.222.0.15 () {54 vars in 943 bytes} [Sun Aug 7 19:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:26.962429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:26.963562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:26.963902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:27.035362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d36ea0-db14-489e-9bb6-c28f7e3aa676 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:27.075478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] MFA Rules not processed for user `d5d8b65b2e324e9c9cbb4e18c715f4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:27.076953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:27.172059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:27.210117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:27.210989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:27.211412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:27.211888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:27.214235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:27.248638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 699/1401] 10.222.0.15 () {58 vars in 1040 bytes} [Sun Aug 7 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:27.261118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:27.273771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0382440-afe4-4779-b64a-ab3d322c0b4c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:27.353713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:27.353975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:27.356702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15f3e-8cf9-4c73-9cbb-bba51ab9bc86 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:27.385744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 703/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:26:27.447332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:27.447999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:27.448245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:27.448510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:27.450652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:27.558995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:27.560921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920a485-f449-4d4a-9094-87114613ceb6 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:27.571569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 700/1403] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 19:26:30.558631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:30.559671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:30.559671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:30.566339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 704/1404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:30.570292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d763-39f5-4f7a-966f-da0c8fc47b34 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:30.571320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d763-39f5-4f7a-966f-da0c8fc47b34 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:30.571320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d763-39f5-4f7a-966f-da0c8fc47b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:30.700794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9f00d763-39f5-4f7a-966f-da0c8fc47b34 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:30.702804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f00d763-39f5-4f7a-966f-da0c8fc47b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:30.773656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:30.898478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 701/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:30.958613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:30.961899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:31.220106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:31.334324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1240-2e12-40d4-910e-65a6ed0a94a7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:31.622858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:31.623922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:31.624075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:31.624255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:31.626305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:31.751157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:31.782104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:31.785584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e9950-64f0-43d0-b19e-64f8dfda84f6 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:31.823723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 705/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:34.142970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:34.143998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:34.143998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:34.145359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 702/1407] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:26:34.151489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e81c5-c94c-4ffe-aed8-1f8439d70244 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:34.152388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e81c5-c94c-4ffe-aed8-1f8439d70244 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:34.152388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e81c5-c94c-4ffe-aed8-1f8439d70244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:34.236922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2d0e81c5-c94c-4ffe-aed8-1f8439d70244 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:34.238542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d0e81c5-c94c-4ffe-aed8-1f8439d70244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:34.395576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 706/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:26:34.447845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:34.451315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:34.692518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567480-1111-4af0-8a2d-81e9aef197f9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:34.714046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:34.851834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:34.852491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:34.852858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:34.853034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:34.854925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:34.988803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:34.990820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91a0f-cc2e-424b-9fe0-397aef170b1d service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:35.014314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:44.388397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=80 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:45.011605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=91 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:52.611896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b3a7-713a-45d3-8b63-24cb45a50f10 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:52.612544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b3a7-713a-45d3-8b63-24cb45a50f10 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:52.612544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b3a7-713a-45d3-8b63-24cb45a50f10 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:52.613838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 707/1410] 10.222.0.15 () {54 vars in 918 bytes} [Sun Aug 7 19:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:52.619862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8438c-33e2-4565-b5fc-3c3943d78998 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:52.620476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8438c-33e2-4565-b5fc-3c3943d78998 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:52.620476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8438c-33e2-4565-b5fc-3c3943d78998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:52.704101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-79c8438c-33e2-4565-b5fc-3c3943d78998 None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:52.705235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-79c8438c-33e2-4565-b5fc-3c3943d78998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:52.819507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Aug 7 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:52.837536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309b8-a31d-4d5a-9735-993f5bcb3577 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:52.837811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309b8-a31d-4d5a-9735-993f5bcb3577 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:52.838103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309b8-a31d-4d5a-9735-993f5bcb3577 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:52.839489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 708/1412] 10.222.0.15 () {54 vars in 918 bytes} [Sun Aug 7 19:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:52.845247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810955f-5eb9-4d58-8be9-02360524da10 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:52.845646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810955f-5eb9-4d58-8be9-02360524da10 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:52.845935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810955f-5eb9-4d58-8be9-02360524da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:52.930284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:52.933548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6810955f-5eb9-4d58-8be9-02360524da10 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:52.935395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6810955f-5eb9-4d58-8be9-02360524da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:53.071476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Aug 7 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:55.615249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:55.615921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:55.615921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:55.617183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:55.623155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdde7f-6f44-4c9f-8928-3401f589edfa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:55.623722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdde7f-6f44-4c9f-8928-3401f589edfa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:55.623876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdde7f-6f44-4c9f-8928-3401f589edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:55.707614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4bbdde7f-6f44-4c9f-8928-3401f589edfa None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:55.708774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4bbdde7f-6f44-4c9f-8928-3401f589edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:55.785635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:55.867020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:55.914696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:55.917631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:56.155310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d80f1-6bc8-4d81-b27c-d9925dd1b0ca None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:56.260226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:56.312273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:56.312896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:56.313174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:56.313439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:56.315335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:56.423032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:56.426166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e107592-1e40-4196-b5f2-3402cc32993a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:56.448586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 710/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:26:57.436549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:57.437112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:57.437112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:57.438456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:57.444969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677ac3c-fbc9-47d5-9b0b-37d63d604f21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:57.445550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677ac3c-fbc9-47d5-9b0b-37d63d604f21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:57.445550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677ac3c-fbc9-47d5-9b0b-37d63d604f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:57.556220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1677ac3c-fbc9-47d5-9b0b-37d63d604f21 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:57.558313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1677ac3c-fbc9-47d5-9b0b-37d63d604f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:57.591806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:57.676173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:57.936666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:57.938469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:58.278656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a683-371d-4174-9680-f4e8fe7e6b05 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:26:58.325573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:58.407519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:26:58.408183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:58.408461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:58.408726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:58.410762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:58.555006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:26:58.556587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d1ff1-36e3-496d-8248-957437104f1a service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:26:58.578257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:26:59.497866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:59.498514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:59.498514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:59.499889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:26:59.506853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72333-8a0c-41eb-a230-5d89892b4f43 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:26:59.507337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72333-8a0c-41eb-a230-5d89892b4f43 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:26:59.507753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72333-8a0c-41eb-a230-5d89892b4f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:26:59.613161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:26:59.654958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-37f72333-8a0c-41eb-a230-5d89892b4f43 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:26:59.656904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-37f72333-8a0c-41eb-a230-5d89892b4f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:26:59.795845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:26:59.947493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:26:59.949565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:00.117566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abe10-41c9-48ac-a2c9-6117e5edcee2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:00.131655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:00.244407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:00.245022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:00.245286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:00.245575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:00.247278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:00.348050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:00.349785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36072f-1482-4b09-933b-d0e784d3f7f5 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:00.369817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 713/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:01.275018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:01.275635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:01.275635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:01.277160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:01.284902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920acfe9-4a44-4289-beb4-5dfdbf0dbdda None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:01.285689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920acfe9-4a44-4289-beb4-5dfdbf0dbdda None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:01.285866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920acfe9-4a44-4289-beb4-5dfdbf0dbdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:01.311884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:01.391153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-920acfe9-4a44-4289-beb4-5dfdbf0dbdda None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:01.392460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-920acfe9-4a44-4289-beb4-5dfdbf0dbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:01.505485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:01.655771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:01.657569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:01.788444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:01.832802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b1a18-e978-4b67-a33d-301b5dba3d7e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:01.986371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:01.986986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:01.987294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:01.987562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:01.989627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:02.071447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:02.086213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:02.087981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ada55-92dd-458e-8e4b-c85556af89f1 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:02.110293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 711/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:03.038076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:03.038754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:03.038754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:03.040335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:03.046487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152e41-3ccb-45e1-8108-7fe4876401ed None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:03.047120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152e41-3ccb-45e1-8108-7fe4876401ed None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:03.047120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152e41-3ccb-45e1-8108-7fe4876401ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:03.141632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c9152e41-3ccb-45e1-8108-7fe4876401ed None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:03.142964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c9152e41-3ccb-45e1-8108-7fe4876401ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:03.258059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:03.410776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:03.412377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:03.523781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:03.588575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644461-c20e-4b85-9f15-2aab8e709ed5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:03.712121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:03.712746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:03.713020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:03.713288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:03.714928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:03.766334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:03.816454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:03.817975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0666-ee3f-4c64-b747-577a4d403b1e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:03.838634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 716/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:04.662108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:04.662714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:04.662714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:04.664193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:04.671840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb968ac-e3b6-48d7-8d71-d46ad8a94895 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:04.672457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb968ac-e3b6-48d7-8d71-d46ad8a94895 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:04.672778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb968ac-e3b6-48d7-8d71-d46ad8a94895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:04.763813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ffb968ac-e3b6-48d7-8d71-d46ad8a94895 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:04.765266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ffb968ac-e3b6-48d7-8d71-d46ad8a94895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:04.914764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:05.067220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:05.069264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:05.126406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:05.237616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344c3cd-0cc1-4ede-ba51-d159f0efe893 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:05.370182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:05.370866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:05.371226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:05.371666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:05.373656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:05.381790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:05.477622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:05.479226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ffce1-33b9-4cb2-a446-3b4e33464865 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:05.498461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 714/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:06.317276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:06.317901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:06.317901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:06.319182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:06.324746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64885-0dab-41c4-a72b-8da19cff11b0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:06.333496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64885-0dab-41c4-a72b-8da19cff11b0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:06.333496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b64885-0dab-41c4-a72b-8da19cff11b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:06.413303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-78b64885-0dab-41c4-a72b-8da19cff11b0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:06.414597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-78b64885-0dab-41c4-a72b-8da19cff11b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:06.486832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:06.517957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:06.668827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:06.670760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:06.690796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:06.839119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e9c9-aedb-4c47-aca7-2cdd601547fe None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:06.935855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:06.965147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:06.965778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:06.966053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:06.966323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:06.968055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:07.067533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:07.069199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f46f34-71c3-424d-9795-01d6366f805d service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:07.089059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 719/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:07.924343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:07.924973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:07.924973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:07.926342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:07.931744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815709-5845-4868-8955-b056b40112c9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:07.932311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815709-5845-4868-8955-b056b40112c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:07.932311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d815709-5845-4868-8955-b056b40112c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:08.148713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d815709-5845-4868-8955-b056b40112c9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:08.149976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d815709-5845-4868-8955-b056b40112c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:08.200492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:08.265743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:27:08.442456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:08.444078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:08.608388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b78ac-21c3-4f9b-8dae-c431ea56cf05 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:08.668656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:08.730767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:08.731419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:08.731694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:08.731959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:08.733594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:08.841727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:08.843418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1df42-81ea-448d-aaec-9f763fc0ad8e service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:08.865212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 717/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:09.699644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:09.700203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:09.700203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:09.701591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:09.707219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25660f-7192-4747-9af4-3d694c946f8c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:09.707907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25660f-7192-4747-9af4-3d694c946f8c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:09.707907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25660f-7192-4747-9af4-3d694c946f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:09.789938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ca25660f-7192-4747-9af4-3d694c946f8c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:09.791270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ca25660f-7192-4747-9af4-3d694c946f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:09.793578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:09.901053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:10.050702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:10.052561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:10.231883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8524f-c912-4a9b-a4c1-21c2e079f2bf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:10.265043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:10.363405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:10.363967 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:10.364243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:10.364507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:10.366214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:10.461976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:10.463613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf57d8-f69a-4558-bbb3-f2d026486767 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:10.482335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 722/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:12.421721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:12.422292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:12.422416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:12.424118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:12.430740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9569-ae3c-4f8b-8600-b1097fa4fcd8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:12.431332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9569-ae3c-4f8b-8600-b1097fa4fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:12.431332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9569-ae3c-4f8b-8600-b1097fa4fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:12.480004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:12.513207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-288f9569-ae3c-4f8b-8600-b1097fa4fcd8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:12.514479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-288f9569-ae3c-4f8b-8600-b1097fa4fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:12.625045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:12.692598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:12.694902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:12.814346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14a7b-096c-4ad9-a7ae-9e91e9860a04 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:12.850472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:12.895774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:12.896394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:12.896658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:12.896923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:12.898671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:13.026576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:13.028055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6b2d4-73d9-4c7a-9aea-776f3b6f6cb5 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:13.056558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 720/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:15.313552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:15.314150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:15.314150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:15.315798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:15.324166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab96c-5a1a-47ef-be1f-1bb4bacc6070 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:15.324987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab96c-5a1a-47ef-be1f-1bb4bacc6070 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:15.324987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ab96c-5a1a-47ef-be1f-1bb4bacc6070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:15.410629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dc5ab96c-5a1a-47ef-be1f-1bb4bacc6070 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:15.412781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dc5ab96c-5a1a-47ef-be1f-1bb4bacc6070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:15.436191 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:15.540148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:15.579919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:15.581690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:15.712357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d642a-3a5e-4c28-9aad-4225c656c647 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:15.727521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:15.797040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:15.797664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:15.797936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:15.798209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:15.800026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:15.938633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:15.940812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6a66-41a4-4204-839d-3ea8abfee030 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:15.963144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 725/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:18.464697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:18.465308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:18.465308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:18.466546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:18.472612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03205dc-7154-4f13-88d8-7c61c3085e96 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:18.473291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03205dc-7154-4f13-88d8-7c61c3085e96 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:18.473291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03205dc-7154-4f13-88d8-7c61c3085e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:18.531223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:18.550214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a03205dc-7154-4f13-88d8-7c61c3085e96 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:18.551481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a03205dc-7154-4f13-88d8-7c61c3085e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:18.653998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:18.695102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:18.696696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:18.820537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb50fda-5f44-45b3-a61b-62370723f8f2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:18.868566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:18.905973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:18.906589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:18.906861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:18.907128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:18.908767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:19.032700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:19.034146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307860c0-e1da-4d62-9c54-e42872afea50 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:19.054095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 723/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:21.204534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:21.205388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:21.205388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:21.207116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:21.215654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abec-7117-407d-be90-e237866591df None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:21.216451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abec-7117-407d-be90-e237866591df None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:21.216637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465abec-7117-407d-be90-e237866591df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:21.298915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d465abec-7117-407d-be90-e237866591df None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:21.300324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d465abec-7117-407d-be90-e237866591df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:21.324989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:21.414823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:21.455381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:21.456948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:21.574290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b315fb-4d8d-40ec-8d23-ea9d0d5b2c80 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:21.597423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:21.657714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:21.658326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:21.658594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:21.658855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:21.660589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:21.781236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:21.782567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb895bd-bd33-4887-b7e7-f8fd07c7798d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:21.804566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 728/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:23.948617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:23.949197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:23.949197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:23.950492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:23.958786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107ae2-47af-423a-ab28-38b82c0dbd48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:23.959651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107ae2-47af-423a-ab28-38b82c0dbd48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:23.959651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107ae2-47af-423a-ab28-38b82c0dbd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:24.032252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:24.037832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-57107ae2-47af-423a-ab28-38b82c0dbd48 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:24.040347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57107ae2-47af-423a-ab28-38b82c0dbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:24.153746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:24.191987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:24.193587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:24.301915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6595e-6cae-48fd-b298-96e3a81b1501 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:24.356242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:24.385428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:24.386395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:24.387118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:24.387744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:24.389580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:24.508792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:24.510281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc1130-75eb-4790-acd9-50bccdca0aa6 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:24.530202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 726/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:26.638128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:26.638779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:26.638779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:26.639939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:26.645650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0b149-ce31-4525-a1c3-842a3186b42e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:26.646162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0b149-ce31-4525-a1c3-842a3186b42e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:26.646162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0b149-ce31-4525-a1c3-842a3186b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:26.716155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1db0b149-ce31-4525-a1c3-842a3186b42e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:26.717406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1db0b149-ce31-4525-a1c3-842a3186b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:26.746283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:26.823131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:26.862235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:26.863887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:26.976801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd25e-4668-47cb-82cb-0835aa5721e9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:27.005802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:27.057657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:27.058305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:27.058584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:27.058855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:27.060575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:27.178079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:27.179553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62846d08-4bdd-4ee7-a693-4aed00231d1e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:27.199988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 731/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:29.293604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:29.294431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:29.294431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:29.296324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:29.302725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1060-2ac2-4b2d-a168-b3b705e80eb0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:29.303232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1060-2ac2-4b2d-a168-b3b705e80eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:29.303232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f1060-2ac2-4b2d-a168-b3b705e80eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:29.378644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7e5f1060-2ac2-4b2d-a168-b3b705e80eb0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:29.379929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7e5f1060-2ac2-4b2d-a168-b3b705e80eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:29.388917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:29.482319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:29.520428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:29.521980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:29.637980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b54dc-1147-4ce3-b6bd-c963617aa325 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:29.698995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:29.719849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:29.720476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:29.720735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:29.721003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:29.722851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:29.845516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:29.846972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b3ff-0123-4466-8c72-33f40e6c88b8 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:29.866082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 729/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:31.924061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:31.924716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:31.924716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:31.926034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:31.932808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe916-761f-4554-986e-710e1c7a033e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:31.933328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe916-761f-4554-986e-710e1c7a033e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:31.933433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe916-761f-4554-986e-710e1c7a033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:32.008066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-81ffe916-761f-4554-986e-710e1c7a033e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:32.009375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-81ffe916-761f-4554-986e-710e1c7a033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:32.056985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:32.132893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:32.173236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:32.175708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:32.298661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea808266-c4b4-4139-8653-5b1bd322b53c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:32.340874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:32.383835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:32.384815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:32.385231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:32.385657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:32.388129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:32.519909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:32.521356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87cec1-1ff2-4225-b62b-81e6006fbcad service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:32.542957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 734/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:34.619662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:34.620340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:34.620340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:34.621613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:34.627568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcef2f-03eb-4890-906d-d38d15b4de58 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:34.628061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcef2f-03eb-4890-906d-d38d15b4de58 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:34.628061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcef2f-03eb-4890-906d-d38d15b4de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:34.700927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-42bcef2f-03eb-4890-906d-d38d15b4de58 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:34.702117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-42bcef2f-03eb-4890-906d-d38d15b4de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:34.726613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:34.811356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:27:34.849987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:34.851653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:34.985821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa29216-d0c9-47b5-bdaf-4219973552ba None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:35.064815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:35.073033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:35.073655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:35.073927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:35.074189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:35.075849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:35.194752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:35.196238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb39fb-9658-4fc0-82e3-956792c78454 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:35.216503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 732/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:37.307628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:37.308231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:37.308231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:37.309554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:37.317309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c00b5-aa42-4324-9c7c-8995a31335aa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:37.317959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c00b5-aa42-4324-9c7c-8995a31335aa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:37.317959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c00b5-aa42-4324-9c7c-8995a31335aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:37.394293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-403c00b5-aa42-4324-9c7c-8995a31335aa None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:37.395590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-403c00b5-aa42-4324-9c7c-8995a31335aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:37.450529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:37.510647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:37.548546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:37.550154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:37.664644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824ac03-0171-416f-9c6f-d1d4562925fe None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:37.716019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:37.746828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:37.747480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:37.747751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:37.748012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:37.749636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:37.864771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:27:37.866156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3f10-7edb-4345-baaa-91e2853a3007 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:27:37.885640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 737/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:27:47.508604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=22 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:47.883107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=66 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:59.081482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe97b1-ffd8-4411-a918-cc18ce9ab590 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:59.082102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe97b1-ffd8-4411-a918-cc18ce9ab590 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:59.082397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe97b1-ffd8-4411-a918-cc18ce9ab590 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:59.085009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 734/1471] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:27:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:59.091768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430bea-a702-4bec-9c73-e3ee42398eea None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:59.092659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430bea-a702-4bec-9c73-e3ee42398eea None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:59.092659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430bea-a702-4bec-9c73-e3ee42398eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:59.176936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7c430bea-a702-4bec-9c73-e3ee42398eea None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:59.178226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c430bea-a702-4bec-9c73-e3ee42398eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:59.298262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 738/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:27:59.395474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:59.395762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:59.396057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:59.397477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 735/1473] 10.222.0.15 () {54 vars in 966 bytes} [Sun Aug 7 19:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:27:59.403597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0016-43b4-4000-9eb0-a16b7a400690 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:59.403929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0016-43b4-4000-9eb0-a16b7a400690 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:59.404238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0016-43b4-4000-9eb0-a16b7a400690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:59.505101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-95dc0016-43b4-4000-9eb0-a16b7a400690 None None] MFA Rules not processed for user `1daf3ae711f0440ca0b26d214a162074`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:27:59.506395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-95dc0016-43b4-4000-9eb0-a16b7a400690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:59.536083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:27:59.626952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 739/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Sun Aug 7 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:27:59.634781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:27:59.636495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:59.771123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd993-4381-4bcb-abfe-573e2fc7760a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:27:59.877908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:27:59.878543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:27:59.878864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:27:59.879219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:27:59.881050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:27:59.948743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:00.018572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:00.020226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef318a-bf30-42db-a8f3-80ac555a6442 service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:00.041933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 736/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:02.276828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:02.277422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:02.277422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:02.279013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 740/1476] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:02.286888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb16d-4cd7-419b-9d4d-fa9947720767 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:02.287631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb16d-4cd7-419b-9d4d-fa9947720767 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:02.287979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb16d-4cd7-419b-9d4d-fa9947720767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:02.381175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fe1cb16d-4cd7-419b-9d4d-fa9947720767 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:02.382572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fe1cb16d-4cd7-419b-9d4d-fa9947720767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:02.539355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 737/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:28:02.564897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:02.566520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:02.724347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2593be-e139-41af-85c0-50fe797e105d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:02.786008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:02.865470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:02.866128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:02.866487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:02.866859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:02.867671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:02.869621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:28:02.869621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:28:02.869621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:28:02.871103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea1ed-e3b9-4d41-9b3d-dad2e26b3698 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:02.893897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 741/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Aug 7 19:28:02 2022] GET /identity/v3/projects => generated 2553 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:28:05.060540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:05.061370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:05.061370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:05.062480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 738/1479] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:05.069476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b567c3-8eb2-4f48-9953-1efff72a69ef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:05.070149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b567c3-8eb2-4f48-9953-1efff72a69ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:05.070149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b567c3-8eb2-4f48-9953-1efff72a69ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:05.146504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6b567c3-8eb2-4f48-9953-1efff72a69ef None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:05.147814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6b567c3-8eb2-4f48-9953-1efff72a69ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:05.260816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 742/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:28:05.312788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:05.314877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:05.325324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:05.477370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ae73-d85e-47b0-8e42-830c2690f84e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:05.563574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:05.602869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:05.603498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:05.603781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:05.604055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:05.605801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:05.701017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:05.702603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff506f-6dae-4bbe-a739-57c28069ba36 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:05.723173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 739/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:08.024078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:08.024729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:08.024729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:08.027094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 743/1482] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:08.035853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edc62-93d4-458a-81b3-8e19ed6faec1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:08.036418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edc62-93d4-458a-81b3-8e19ed6faec1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:08.036418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edc62-93d4-458a-81b3-8e19ed6faec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:08.116362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-012edc62-93d4-458a-81b3-8e19ed6faec1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:08.117625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-012edc62-93d4-458a-81b3-8e19ed6faec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:08.188849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:08.261541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 740/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:28:08.299401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:08.300993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:08.328705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:08.421700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c538964-ee82-4507-8abc-7b8dbbaf36eb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:08.509641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:08.510296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:08.510554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:08.510824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:08.512574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:08.621342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:08.664609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:08.666145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c4e77-4c54-47ca-a20d-4fd3a9cee644 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:08.686660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 744/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:10.841604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:10.842479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:10.842479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:10.844568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 741/1485] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:10.852439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685d02-0dd1-412a-87e2-3595adb0186e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:10.852919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685d02-0dd1-412a-87e2-3595adb0186e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:10.853027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685d02-0dd1-412a-87e2-3595adb0186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:10.925159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-19685d02-0dd1-412a-87e2-3595adb0186e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:10.926389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-19685d02-0dd1-412a-87e2-3595adb0186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:11.027001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 745/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:28:11.072455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:11.074943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:11.182787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40696aa-4c6e-41ba-a9a3-7611c1e97450 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:11.267912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:11.269897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:11.270562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:11.271108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:11.271415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:11.274066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:11.390708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:11.392137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f60a5-48cd-440e-897c-cebd73c45e7f service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:11.411984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 742/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:13.628201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:13.629143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:13.629143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:13.630898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 746/1488] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:13.645170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa3bc-0e58-4201-b879-27f4eb3e9412 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:13.645828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa3bc-0e58-4201-b879-27f4eb3e9412 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:13.645828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaa3bc-0e58-4201-b879-27f4eb3e9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:13.743731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cacaa3bc-0e58-4201-b879-27f4eb3e9412 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:13.745824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cacaa3bc-0e58-4201-b879-27f4eb3e9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:13.831423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:13.915683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 743/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:28:13.959330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:13.960944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:14.004800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:14.084478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281cea1-b8a2-4125-8f30-1ea23480ae2f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:14.172615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:14.173286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:14.173563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:14.173835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:14.175600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:14.284301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:14.319813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:14.321370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92e0a-187b-4ed9-b062-4fd98b3ce357 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:14.342991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 747/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:16.617660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:16.618285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:16.618285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:16.619589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 744/1491] 10.222.0.15 () {54 vars in 927 bytes} [Sun Aug 7 19:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:28:16.626255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e12b70-502d-4198-b21c-41985bc375a3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:16.626781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e12b70-502d-4198-b21c-41985bc375a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:16.626781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e12b70-502d-4198-b21c-41985bc375a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:16.698297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-38e12b70-502d-4198-b21c-41985bc375a3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:28:16.699479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-38e12b70-502d-4198-b21c-41985bc375a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:16.802302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 748/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Aug 7 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:28:16.843071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:28:16.844673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:16.956838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d89454-8ee0-40ca-a77c-f34c030a49db None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:28:17.038363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:28:17.039141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:28:17.039475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:28:17.039740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:28:17.041960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:28:17.052153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:17.163065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:28:17.164642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b280f4-eca1-441d-9509-d0970be32333 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:28:17.184140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 745/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:28:26.800510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=82 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:28:27.181760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=50 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:50.096312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:50.096947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:50.096947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:50.193813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:29:50.195078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:50.306098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 749/1494] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:29:50.316291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:50.316908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:50.316908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:50.404594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:29:50.405740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:50.522598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 746/1495] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:29:50.527762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:50.529104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:50.541248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7575e7d-1c91-4989-99a1-bb7417e1f2e3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:50.612168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:50.652557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:50.653328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:50.653576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:50.653841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:50.654534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:29:50.654868 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:50.655909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:50.655909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:29:50.655909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:29:50.656814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:50.670289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 750/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:29:50.679041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:50.688974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05beb1-7f4d-468b-abac-68a2e58e5bde None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:50.753346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:50.792973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:50.793597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:50.793877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:50.794141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:50.794784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:50.796577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:50.796577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:29:50.796577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:29:50.797861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:50.857522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 747/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:29:50 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:29:50.863553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:50.865126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:50.900639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96239-2c1e-4e70-ba97-62756bd16b9f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:51.010687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:51.011370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.011620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.011893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.012512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:51.013540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:51.013540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:29:51.013540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:29:51.014771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:51.061372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 751/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:29:50 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:29:51.066060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:51.067687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:51.139034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c468-67b8-455a-964c-b08a47cd61a0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:51.232879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:51.246125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:51.246794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.247087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.247415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.248078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:51.249129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:51.249129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:29:51.249129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:29:51.250055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:51.263887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 748/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:29:51.268384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:51.269991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:51.282027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b2c8-afeb-4be9-a88e-37402d2b4549 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:51.316028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:51.391865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:51.392476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.392745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.393008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.393725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:51.394735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:51.394735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:29:51.394735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:29:51.395654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88830b17-4ce2-4e60-ab4e-8339dbe480f4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:51.408778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 752/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:29:51.413245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:51.414782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:51.452151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc21a-a8db-464b-887b-b3904d5134f8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:51.561749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:51.562326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.562600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.562873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] PATH_INFO: `/v3/projects/01a75d55564c46b494fe194bf4fa67e4/users/bce0b2b22b5348dc8c34b003f04c70b9/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.588511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a75d55564c46b494fe194bf4fa67e4, user_id=bce0b2b22b5348dc8c34b003f04c70b9, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:51.589575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:51.589575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:29:51.589575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:29:51.591577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8090d9-53b6-4029-863b-d9e107cb9733 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:51.620857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 749/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:29:51 2022] PUT /identity/v3/projects/01a75d55564c46b494fe194bf4fa67e4/users/bce0b2b22b5348dc8c34b003f04c70b9/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:29:51.633387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de28d83-9b46-4e3e-820a-3d9c0f3ea51a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.633714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de28d83-9b46-4e3e-820a-3d9c0f3ea51a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.633893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de28d83-9b46-4e3e-820a-3d9c0f3ea51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.695305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1de28d83-9b46-4e3e-820a-3d9c0f3ea51a None None] MFA Rules not processed for user `bce0b2b22b5348dc8c34b003f04c70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:29:51.696549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1de28d83-9b46-4e3e-820a-3d9c0f3ea51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:51.773164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 753/1502] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:29:51.786900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.787180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.787484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.788821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 750/1503] 10.222.0.15 () {54 vars in 964 bytes} [Sun Aug 7 19:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:29:51.794770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb58d7-4b31-4567-ae6f-22ca2152358d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:51.795183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb58d7-4b31-4567-ae6f-22ca2152358d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:51.795647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb58d7-4b31-4567-ae6f-22ca2152358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:51.832538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:51.880278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1beb58d7-4b31-4567-ae6f-22ca2152358d None None] MFA Rules not processed for user `ad86d22df95d41c4b328c1e6c19381c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:29:51.881520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1beb58d7-4b31-4567-ae6f-22ca2152358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:51.964776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 754/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Aug 7 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:29:51.973411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:51.974957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:52.030318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:52.096897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8c9fa-6a18-4573-af0f-e710b13cfaaa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:52.176506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:52.177122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:52.177395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:52.177658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:52.179299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:52.292456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:52.293901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:52.297462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:52.312897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 751/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:29:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:29:52.360361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2283-309d-4fa8-9215-87d20addd563 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:52.360833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2283-309d-4fa8-9215-87d20addd563 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:52.360949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c2283-309d-4fa8-9215-87d20addd563 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:52.362185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 755/1506] 10.222.0.15 () {52 vars in 830 bytes} [Sun Aug 7 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:29:52.366161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:52.367424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:52.480496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafccf3-1e52-43f4-9fac-9b37663af6a1 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:52.580458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:52.581103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:52.581379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:52.581648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] PATH_INFO: `/v3/users/bce0b2b22b5348dc8c34b003f04c70b9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:52.597534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce0b2b22b5348dc8c34b003f04c70b9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:52.598512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:52.598512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:29:52.598512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:29:52.599758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:52.610247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:52.685088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce0b2b22b5348dc8c34b003f04c70b9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:52.685521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce0b2b22b5348dc8c34b003f04c70b9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:52.686634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce0b2b22b5348dc8c34b003f04c70b9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:52.705833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce0b2b22b5348dc8c34b003f04c70b9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:52.732370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce0b2b22b5348dc8c34b003f04c70b9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:52.750773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 752/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:29:52 2022] DELETE /identity/v3/users/bce0b2b22b5348dc8c34b003f04c70b9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:29:52.755730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:52.756015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:52.756299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:52.817891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:29:52.819126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:52.905657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:52.914233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 756/1508] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:29:52.924076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:52.925658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:53.040736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374856-1be2-450c-afa0-149cba3590d0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:53.113021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:29:53.150364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:53.150995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:53.151327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:53.151590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:53.153222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:53.284016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:53.285466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a5c0-0f3e-496c-af1c-c76cf4c91a67 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:53.304838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 753/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:29:53.793092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:29:53.795408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:29:53.818036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d6d7-9eac-40a9-8f7c-7befbb544e9d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:29:53.940944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:29:53.941600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:29:53.941871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:29:53.942137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] PATH_INFO: `/v3/projects/01a75d55564c46b494fe194bf4fa67e4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:29:53.954097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a75d55564c46b494fe194bf4fa67e4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:29:53.955437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:29:53.955437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:29:53.955437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:29:53.957042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:29:54.028772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a75d55564c46b494fe194bf4fa67e4', 'request_id': 'req-f487314e-6058-4cb6-860b-d72ea1e76e4c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:54.045938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a75d55564c46b494fe194bf4fa67e4', 'request_id': 'req-f487314e-6058-4cb6-860b-d72ea1e76e4c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:54.058701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a75d55564c46b494fe194bf4fa67e4', 'request_id': 'req-f487314e-6058-4cb6-860b-d72ea1e76e4c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:54.104025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] The token cache is being invalidate because project 01a75d55564c46b494fe194bf4fa67e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:29:54.104420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:54.105213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f487314e-6058-4cb6-860b-d72ea1e76e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:29:54.107749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 757/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:29:53 2022] DELETE /identity/v3/projects/01a75d55564c46b494fe194bf4fa67e4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:30:03.302579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=62 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:30:04.099178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:30.618050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:30.618712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:30.618942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:30.620969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:31:30.626938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1860-4507-4656-a21a-881441e03113 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:30.627656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1860-4507-4656-a21a-881441e03113 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:30.627656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1860-4507-4656-a21a-881441e03113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:30.715737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-392c1860-4507-4656-a21a-881441e03113 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:30.716910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-392c1860-4507-4656-a21a-881441e03113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:30.840607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:30.996892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:30.999476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:31.143474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb3e03-4007-4f3e-9b9d-15d8ce9d2b33 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:31.149599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:31.150223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:31.150500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:31.150775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:31.160470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:31.162076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894125fd-c179-4777-bdf0-23933281aa9b service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:31.172360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 755/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:31:32.032077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9957-2ccc-4673-b47b-51920bbda5bf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:32.032673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9957-2ccc-4673-b47b-51920bbda5bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:32.032673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9957-2ccc-4673-b47b-51920bbda5bf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:32.034273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:32.039912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6cf7-a480-4d37-85a8-addfdedf85f4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:32.040447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6cf7-a480-4d37-85a8-addfdedf85f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:32.040447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6cf7-a480-4d37-85a8-addfdedf85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:32.062753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-002c6cf7-a480-4d37-85a8-addfdedf85f4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:32.064043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-002c6cf7-a480-4d37-85a8-addfdedf85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:32.073325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:32.162456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627bb0-e296-43e7-ac69-3813f05eaf90 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:32.162807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627bb0-e296-43e7-ac69-3813f05eaf90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:32.163176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60627bb0-e296-43e7-ac69-3813f05eaf90 None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:32.164594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 760/1516] 10.222.0.44 () {54 vars in 925 bytes} [Sun Aug 7 19:31:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:31:32.183973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca87-8373-45fd-ad18-b059feccd9f4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:32.184416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca87-8373-45fd-ad18-b059feccd9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:32.184768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ca87-8373-45fd-ad18-b059feccd9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:32.224069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60627bb0-e296-43e7-ac69-3813f05eaf90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:32.240414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60627bb0-e296-43e7-ac69-3813f05eaf90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:32.247353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:32.248011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:32.248275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:32.248554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:32.258345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:32.260015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cbd77-e1d5-42e9-85ce-a9349ac0dc56 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:32.263105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c775ca87-8373-45fd-ad18-b059feccd9f4 None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:32.265324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c775ca87-8373-45fd-ad18-b059feccd9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:32.270917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 761/1517] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:31:32.344411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:32.367066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 757/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Sun Aug 7 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:31:41.341324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c127ea-559c-4cc1-bf35-09b86f322175 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:41.341953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c127ea-559c-4cc1-bf35-09b86f322175 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:41.341953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c127ea-559c-4cc1-bf35-09b86f322175 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:41.343326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 762/1519] 10.222.0.15 () {54 vars in 961 bytes} [Sun Aug 7 19:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:41.349016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faf7-c3f5-4417-8460-b5498313550b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:41.349571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faf7-c3f5-4417-8460-b5498313550b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:41.349571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faf7-c3f5-4417-8460-b5498313550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:41.372165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3378faf7-c3f5-4417-8460-b5498313550b None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:41.373548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3378faf7-c3f5-4417-8460-b5498313550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:41.383219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 758/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Aug 7 19:31:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:41.391308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c127ea-559c-4cc1-bf35-09b86f322175 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:41.406756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c127ea-559c-4cc1-bf35-09b86f322175 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:41.413196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:41.413826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:41.414084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:41.414341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:41.424017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:41.425645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac076253-a67a-47bf-a22a-e90b8f85678c service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:41.436723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 763/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:43.533739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe84ab-7eed-4462-b106-160d63a62c66 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:43.534381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe84ab-7eed-4462-b106-160d63a62c66 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:43.534381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe84ab-7eed-4462-b106-160d63a62c66 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:43.535948 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:43.541471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852505-3b4e-48b1-b4df-45436957534f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:43.542052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852505-3b4e-48b1-b4df-45436957534f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:43.542052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03852505-3b4e-48b1-b4df-45436957534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:43.563704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-03852505-3b4e-48b1-b4df-45436957534f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:43.564490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03852505-3b4e-48b1-b4df-45436957534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:43.572813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:43.728721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe84ab-7eed-4462-b106-160d63a62c66 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:43.751111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe84ab-7eed-4462-b106-160d63a62c66 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:43.757464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:43.758109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:43.758383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:43.758653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:43.768476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:43.770328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0f122-d34e-4f43-bb1f-2bd5b04c8263 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:43.781303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 760/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:44.620230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd928a-839a-449e-a39a-efa430e269cd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:44.620887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd928a-839a-449e-a39a-efa430e269cd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:44.621144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd928a-839a-449e-a39a-efa430e269cd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:44.623824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 19:31:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:44.630743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ea55-5762-4083-b9d6-7db98d0e7e2a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:44.631405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ea55-5762-4083-b9d6-7db98d0e7e2a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:44.631700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ea55-5762-4083-b9d6-7db98d0e7e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:44.664996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d8c9ea55-5762-4083-b9d6-7db98d0e7e2a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:44.666883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d8c9ea55-5762-4083-b9d6-7db98d0e7e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:44.680400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 19:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:44.920525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd928a-839a-449e-a39a-efa430e269cd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:44.937603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd928a-839a-449e-a39a-efa430e269cd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:44.943701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:44.944295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:44.944646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:44.944958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:44.954702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:44.956370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e94855-16d3-454f-ab08-a2fe3fa44d84 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:44.967702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 766/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:48.863103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:48.863699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:48.863699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:48.865011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:48.870732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8614-23dc-4e23-b84b-d4db99e483e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:48.871361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8614-23dc-4e23-b84b-d4db99e483e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:48.871361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8614-23dc-4e23-b84b-d4db99e483e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:48.893663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-87ca8614-23dc-4e23-b84b-d4db99e483e3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:48.894898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-87ca8614-23dc-4e23-b84b-d4db99e483e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:48.904045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:31:49.083035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:49.085061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:49.178302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0253132-12f6-4a5d-bba0-a19643dabdbb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:49.182357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:49.183006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:49.183314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:49.183583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:49.194793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:49.196305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcb60-1a0c-44bc-bacc-e6ea79f7ff40 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:49.207222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 763/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:51.316940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65389c8-d9a6-49bc-b5ae-7e255afae828 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:51.317564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65389c8-d9a6-49bc-b5ae-7e255afae828 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:51.317891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65389c8-d9a6-49bc-b5ae-7e255afae828 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:51.320436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:31:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:51.329246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64d63-0b6d-4439-8c9c-160d2913ad0c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:51.329902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64d63-0b6d-4439-8c9c-160d2913ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:51.329902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64d63-0b6d-4439-8c9c-160d2913ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:51.350946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-35e64d63-0b6d-4439-8c9c-160d2913ad0c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:51.352234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-35e64d63-0b6d-4439-8c9c-160d2913ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:51.360709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:51.398868 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65389c8-d9a6-49bc-b5ae-7e255afae828 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:51.411382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65389c8-d9a6-49bc-b5ae-7e255afae828 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:51.415347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:51.415954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:51.416227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:51.416494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:51.427336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:51.429208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6867-62ce-43b6-8286-813048554ca9 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:51.441359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 769/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:54.906302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:54.906878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:54.906878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:54.908678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:54.915792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adad5-5fc6-4df2-8498-c4f8fc1f59a0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:54.916248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adad5-5fc6-4df2-8498-c4f8fc1f59a0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:54.916355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783adad5-5fc6-4df2-8498-c4f8fc1f59a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:54.924608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:31:54.937729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-783adad5-5fc6-4df2-8498-c4f8fc1f59a0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:54.938941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-783adad5-5fc6-4df2-8498-c4f8fc1f59a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:54.947457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:55.251738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:55.253896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:55.348631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfad76-97df-47c3-ba11-d9c2cc1e5302 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:55.352693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:55.353324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:55.353598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:55.353864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:55.365138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:55.367138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03dd07-506f-4658-88ae-c12e19ceb5a1 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:55.378664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 766/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:31:57.392182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:57.392746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:57.392746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:57.393993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 19:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:31:57.399518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae51f-2b24-4441-9620-c024cf67c120 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:57.400260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae51f-2b24-4441-9620-c024cf67c120 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:57.400260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae51f-2b24-4441-9620-c024cf67c120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:57.429385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-643ae51f-2b24-4441-9620-c024cf67c120 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:31:57.430637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-643ae51f-2b24-4441-9620-c024cf67c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:57.442469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 19:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:31:57.758502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:31:57.761399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:31:57.783163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02176ae-6965-48c4-9b9d-ff9f4a21d3b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:31:57.789492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:31:57.790365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:31:57.790683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:31:57.791033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:31:57.802156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:31:57.803622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9a79c-f8e5-4901-8a45-c7638cca391b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:31:57.813657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 772/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:32:07.423869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:32:07.809013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:29.056610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.058247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.058721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.106024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.108108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.131587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 768/1540] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.141259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.146555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.146555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.178327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.179635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.195872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 773/1541] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.201035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:29.224097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37380a-d2c1-4435-a5f2-3ec5484af108 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:29.232395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:29.233606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.234129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.234605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.235812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:29.236345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:29.238278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:29.238278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:33:29.238278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:33:29.239951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:29.273183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 769/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:29.280995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:29.297220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c61a-5b59-4ae2-abb2-ae2a790527ca None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:29.307969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:29.308675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.308961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.309496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.310483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:29.311576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:29.311576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:33:29.311576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:33:29.312812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ff59-6619-46b7-b995-a7d4efac8c6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:29.375108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 774/1543] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:29.383069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:29.413521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e109-bb6e-4ff8-ab57-1af922ce0c33 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:29.421751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0252c-b64c-44b7-a8f2-aa9513935d3e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.422087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0252c-b64c-44b7-a8f2-aa9513935d3e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.422414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0252c-b64c-44b7-a8f2-aa9513935d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.477241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-edb0252c-b64c-44b7-a8f2-aa9513935d3e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.479276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-edb0252c-b64c-44b7-a8f2-aa9513935d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.616459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 775/1544] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:33:29.618467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87d79b-bf0f-4bf5-a753-df72abb74282 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.618738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87d79b-bf0f-4bf5-a753-df72abb74282 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.619048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87d79b-bf0f-4bf5-a753-df72abb74282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.661500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:29.662582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.663068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.671036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.672437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:29.674969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:29.674969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:33:29.674969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:33:29.677412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d1a2-7d4c-43fa-ade5-49314e2d2cbb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:29.699528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-af87d79b-bf0f-4bf5-a753-df72abb74282 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.701713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-af87d79b-bf0f-4bf5-a753-df72abb74282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.745669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.750432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.750753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.751107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.778043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 770/1546] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/users => generated 290 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:29.780889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abdb7f-86b9-4483-b4e2-6274d6c3b44a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.781236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abdb7f-86b9-4483-b4e2-6274d6c3b44a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.781440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abdb7f-86b9-4483-b4e2-6274d6c3b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.822017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.823362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.846119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-40abdb7f-86b9-4483-b4e2-6274d6c3b44a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.848449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-40abdb7f-86b9-4483-b4e2-6274d6c3b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.853464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 777/1547] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.855120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:29.887922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3c94-e921-4bd7-b6e4-1cb747f63d45 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:29.888197 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 771/1548] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.890405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.890876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.891393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.906094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:29.907390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.907879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.908354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.909568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:29.917693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:29.947963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 778/1549] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:29.948913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:29.960310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f327-0efe-45f6-bed8-3c8e48f7b538 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:29.965886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:29.967138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:29.973197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:29.973929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:29.974379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:29.974646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:29.975385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:29.975684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:29.977349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3348f6e-b6a8-4ace-84e0-1317d2398681 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:29.997618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 772/1550] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:29.998745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.014382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 779/1551] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:30.015956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.016290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.016570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.036570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595d732-1e6e-4f9d-a493-3494c6c25d15 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.064860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.066094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.066594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.066899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.069164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.070581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:30.071125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.074617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.079005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc0584-9ab9-49d2-b642-42a7b65f0eb1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.113676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 780/1552] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.115351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.130658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 773/1553] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:30.132183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.132500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.132767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.152848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0108265-7145-490b-90a9-9f6d7aa917e0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.169662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.170727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.171279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.171749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.172952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.177610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9803a-c9db-499c-a987-0bef94d659fc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.180483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.182043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.192880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 774/1554] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.193947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.200669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 781/1555] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:30.202921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.203439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.203877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.208617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6795b3-1a32-42f3-a467-1db4b9d7082d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.214624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.215610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.216213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.216648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.217493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.219554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f9cd-b1bf-4c86-80d4-b818ac696b6b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.238213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.239875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.250291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 782/1556] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.252014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.261185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 775/1557] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.263694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.264172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.264660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.273121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae5a64-f13e-4efe-a092-1fe57228b90b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.292539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.293949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.349110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.349752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.350057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.350332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.350982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.353005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d822-ad5c-4def-9d02-666e35621bdb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.359832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:30.389569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 783/1558] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.391168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.391523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.391773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.401971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 776/1559] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.403341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.420180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6695ecd-8303-4cea-85e5-ef9721b435a1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.436628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.439111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.439349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:30.515041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.516311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.516805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.517300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.518599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:30.519132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.520273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 784/1560] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.521093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.522637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801fc6-e2a9-47d7-a5be-ebd7b148e8d9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.533007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535f2f-2f02-4707-820b-bfa1566990dd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.538539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.539571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.539843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.540112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] PATH_INFO: `/v3/projects/c830c4f3b75e43b9bc4d4095444b0838/users/9a1411b0bd2449708c5be668586b777c/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.548809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 777/1561] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:30.552121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.552696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.553233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.566160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c830c4f3b75e43b9bc4d4095444b0838, user_id=9a1411b0bd2449708c5be668586b777c, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.567310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:30.567310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:33:30.567310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:33:30.569391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.585660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 785/1562] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:30 2022] PUT /identity/v3/projects/c830c4f3b75e43b9bc4d4095444b0838/users/9a1411b0bd2449708c5be668586b777c/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:30.586774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.590290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.592819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.664073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df496b3-5b99-41e7-ac29-851f8bd78580 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.671221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.671935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.672256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.672628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.673420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:30.673789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.675788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.691484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 786/1563] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:30.692350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.697150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 778/1564] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.700170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.709245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1707d9-4364-480e-baaf-5eef8d7dac03 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.712536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e75293-eac1-4d61-bd20-c27a59c8b9f4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.714858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.715691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.716125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.716588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.717665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.719181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.720309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.720878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.721243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c347-d728-4f8a-a916-0e651a281ea0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.721442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.722573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.725880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2b5c7-15eb-4a53-8152-2872d37e39a5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.758667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 787/1565] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/users => generated 287 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.759031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 779/1566] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/users => generated 295 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.760803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5409ee-6272-4f92-b753-9629e819594c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.761156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.761272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5409ee-6272-4f92-b753-9629e819594c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.761598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.761708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5409ee-6272-4f92-b753-9629e819594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.762028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.786190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.787482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.796215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 780/1567] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.797077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.802714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dc5409ee-6272-4f92-b753-9629e819594c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.804850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc5409ee-6272-4f92-b753-9629e819594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.817371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acad9a8-e038-4782-a9d7-72ee29e200af None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.817771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 788/1568] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.820271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.820728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.821182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.828901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.829935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.830396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.830795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.831746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.834374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8e154-acab-4789-83a3-c4876f897bfe admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.846329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.847923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.857678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 789/1569] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:30.859119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.877511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee4b2e-2760-4973-9183-5be948279d3d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:30.886510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 781/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.886510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd123-3730-413e-a487-ab0514d347dc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.886950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:30.887150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd123-3730-413e-a487-ab0514d347dc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.887150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd123-3730-413e-a487-ab0514d347dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.887467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:30.887467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:30.887467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:30.887467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:30.889438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:30.908762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-771bd123-3730-413e-a487-ab0514d347dc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:30.911092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-771bd123-3730-413e-a487-ab0514d347dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:30.927591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 790/1571] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:30.929071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:30.937621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:30.999328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 782/1572] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:31.000919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd123-3730-413e-a487-ab0514d347dc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.011795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee723b-fba9-46ea-a326-c4871731f61d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.016946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.017397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:31.017776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.018053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.018693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.019930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.021916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.032933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd123-3730-413e-a487-ab0514d347dc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.040158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 791/1573] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.040158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.046750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.047653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.048296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.048726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.049771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.051314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d7b1-5e32-470a-a2d9-12279322950c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.052029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.057786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.058613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.059070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.059477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.060653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:31.064890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 783/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.065993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.070669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.072713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.076995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88496b4-cc6a-4d82-84fb-23f85b6adb3c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.087239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.088394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.088780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.089208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.090085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:31.090753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 792/1575] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:31.090942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.091534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.093897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:31.099436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.125817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 784/1576] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:31.130734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.156724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8b1f-ac34-4d96-85c7-be3e703649d1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.163873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a098-5420-4785-a108-1a53be26221d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.166359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.167552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.168029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.168512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.168656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.169182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.169453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.169676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.169831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.173515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.180266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.181644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.196271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 793/1577] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:31.197067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.208255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f126-ee92-4888-846e-55c2e6377b35 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.214635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.215384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.215662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.215935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.216800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.218935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.225800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 785/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.227593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.253307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 794/1579] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.253307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.253685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd4d5-3086-4914-be48-7525dcae65a4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.261403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.262466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.262910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.263299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.264709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:31.265286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.267057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111a49-410b-4446-a8d5-86e48c15a49c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.268936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.274095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.274678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.275015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.275382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.276192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.277970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.294481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 795/1580] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.296850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.303352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 786/1581] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:31.303352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.324436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696f917-132b-4a69-b922-224805cd64af admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.324807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a587f-a035-4657-9b95-7c9b9ec87d6c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.333084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.333388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.334280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.334398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.334809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.335134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.335341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.335741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.336563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.337025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.339856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.340610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.365608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 796/1582] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.365608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.381104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5cffe-351c-4a2f-88c6-75b6a35d3aa3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.389532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.390638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.391160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.391690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.392867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.398783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 787/1583] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.399028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.399133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.458687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 797/1584] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.458687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.521007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774652-0929-4ad9-9009-005de1cc0eb2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.526319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:31.606739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12de1-fd04-4bdf-88c1-b2b9cb3515c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.619861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.621427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.623460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.624286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.625627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.627540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.628232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.628512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.628806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.629013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.629838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.632081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.648822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 788/1585] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.648822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.649295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 798/1586] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:31.649295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.658746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dc026-c3a6-48fa-97e0-450d5cf5a92e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.664547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae313e15-f954-4b3d-aec2-5af8faa77d69 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.665018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.665732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.666046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.666322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] PATH_INFO: `/v3/projects/ae87904bb46448e692c6999107b920d1/users/781069d6a33d45539639b4ff3cf22230/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.680260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.681635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.682105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.682559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.683854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.687948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.701910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae87904bb46448e692c6999107b920d1, user_id=781069d6a33d45539639b4ff3cf22230, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.706636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.730381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 789/1587] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:31 2022] PUT /identity/v3/projects/ae87904bb46448e692c6999107b920d1/users/781069d6a33d45539639b4ff3cf22230/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:31.731660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.742653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 799/1588] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.748286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.757377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:31.910099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c892e-8010-4b65-b572-b968bb39b816 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.917208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.917854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.918156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.918439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.919087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.919273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421d19-07e7-4ba8-b2b2-d8268431f190 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.921179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.929359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:31.932230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:31.932486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:31.933606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] PATH_INFO: `/v3/projects/ce361cbc0fa34c7986e495b4fbf510e1/users/26adbd5487f0466d9b36adc4d6f768dc/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:31.954654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 800/1589] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:31.956299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:31.960930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce361cbc0fa34c7986e495b4fbf510e1, user_id=26adbd5487f0466d9b36adc4d6f768dc, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:31.964366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:31.974376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dd43-c1bd-4a8e-9238-f89899598711 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:31.985569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 790/1590] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:31 2022] PUT /identity/v3/projects/ce361cbc0fa34c7986e495b4fbf510e1/users/26adbd5487f0466d9b36adc4d6f768dc/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:31.988628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.071828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.072730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.073137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.073573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.074546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.076823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.087273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c04887-a4c2-42e3-a5f5-4a5f9a7b2079 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.095728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.096644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.097036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.097241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.098105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.099880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64140790-b5af-4eb6-9dfb-2c2e77fb8808 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.106364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 801/1591] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:31 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:32.108007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.120462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 791/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.120462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.120462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.120462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.127294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e44e2-b8c4-4f47-a45c-3cfe6fba505b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.134268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.135404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.135941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.136453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.137454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.139949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.150603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] MFA Rules not processed for user `781069d6a33d45539639b4ff3cf22230`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:32.151924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:32.156731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 802/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.158695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.177169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd8dba-3ca0-4936-9dec-4a81d0170306 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.187063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.188184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.188666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.189149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.190324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.194090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.211099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:32.236300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 803/1594] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:32 2022] POST /identity/v3/users => generated 284 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:32.238334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.249662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559b5c8-89a4-4436-99d4-da3da7e00c58 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.254759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.255454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.255736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.256010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.256718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.258426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc34fa4-1fc6-44e1-bdfd-dca42bdc6b01 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.270167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 804/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.271566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.271853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.272130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.285807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 792/1596] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:32.287446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.312381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022e69-08e4-4f3f-857e-e1ea4b275101 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.324766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:32.325049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.326904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.327176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:32.327685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.328286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.329720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.333147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.343468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 805/1597] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:32.343468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.357313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 793/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.358709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.360726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e1bc5-1eb1-477d-b275-8c09b2438f31 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.370071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.371271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.371778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.373099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] PATH_INFO: `/v3/projects/0f6a41378f1b490fa7d707645929316e/users/b2991e420f3644feb5a0f2528b34cfd6/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.373302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:32.377021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ac4e2-6682-47ef-a9e9-ee2ab4bbab2e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.386503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.387239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.387556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.387812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] PATH_INFO: `/v3/projects/ae4d1034b64d4c2d8ab38060db9c81ad/users/7ca847eacc0040b1af9a8c198d7b6daa/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.404871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6a41378f1b490fa7d707645929316e, user_id=b2991e420f3644feb5a0f2528b34cfd6, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.407658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4d1034b64d4c2d8ab38060db9c81ad, user_id=7ca847eacc0040b1af9a8c198d7b6daa, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.410518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.411438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.443282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 806/1599] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:32 2022] PUT /identity/v3/projects/0f6a41378f1b490fa7d707645929316e/users/b2991e420f3644feb5a0f2528b34cfd6/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:32.443282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.455902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 794/1600] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:32 2022] PUT /identity/v3/projects/ae4d1034b64d4c2d8ab38060db9c81ad/users/7ca847eacc0040b1af9a8c198d7b6daa/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:32.457050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.561875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8a364-eb70-4e0f-bd74-ab974e30222e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.600861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efc64f-b72e-4977-a506-c5c70e62f554 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.607594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.608302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.608612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.608887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.609582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.611453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb85fad-b7cb-472d-9797-23358a12b0c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.629408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 795/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.629408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20905a13-b1f9-4474-b806-3141b587b9bd None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.629408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20905a13-b1f9-4474-b806-3141b587b9bd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.629408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20905a13-b1f9-4474-b806-3141b587b9bd None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.629408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 796/1602] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 19:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:32.630325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20905a13-b1f9-4474-b806-3141b587b9bd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.703636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20905a13-b1f9-4474-b806-3141b587b9bd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.712845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.715046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.715956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.717155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.717358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.718096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.718440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.718710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.719592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.721832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.742891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 807/1603] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.742891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:32.755016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.759188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4273-0dc2-4e69-8e9a-60afccb8db30 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:32.763391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:32.764407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.764984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.765547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.766349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:32.766804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcebbe8-1319-4d61-9b0a-78f58f5dc8bd service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.768297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2472a0-ed08-4268-92e4-66bcb6087e9b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:32.784741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 808/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:32.786770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519004f7-1e94-4821-831d-93f73883c177 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.787313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519004f7-1e94-4821-831d-93f73883c177 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.787769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519004f7-1e94-4821-831d-93f73883c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.795653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 797/1605] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:32.798491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:32.798739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:32.798944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:32.845690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-519004f7-1e94-4821-831d-93f73883c177 None None] MFA Rules not processed for user `b2991e420f3644feb5a0f2528b34cfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:32.848093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-519004f7-1e94-4821-831d-93f73883c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:32.854474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] MFA Rules not processed for user `7ca847eacc0040b1af9a8c198d7b6daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:32.856627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:32.930720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:32.984735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 798/1606] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:32.986534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.002608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275156-5ec9-4c3c-b679-601dbe74b388 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.008817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:33.009963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.010236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.010557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] PATH_INFO: `/v3/projects/d472b7dc4b5e4f808bee80715c2f29f7/users/cd53375218ec492e8e250efe42b3d09c/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.012632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 809/1607] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:33.016094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:33.037954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d472b7dc4b5e4f808bee80715c2f29f7, user_id=cd53375218ec492e8e250efe42b3d09c, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:33.038141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.038509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.039001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.041168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:33.078950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 799/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:32 2022] PUT /identity/v3/projects/d472b7dc4b5e4f808bee80715c2f29f7/users/cd53375218ec492e8e250efe42b3d09c/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:33.078950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.187593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:33.189617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:33.203165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b591-06aa-4739-a1ac-df8d5c126b28 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.211148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:33.212937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.214692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.215540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.216418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:33.218417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:33.246858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 800/1609] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:33.246858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.287988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95ec5-87ed-4848-8b1f-bb22200c4f87 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.312459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:33.316799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.317507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.317987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] PATH_INFO: `/v3/projects/07a0b29b945f44829bf3a233e37db090/users/db3d6effb7b34ad4afdfc9651b458e78/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.361310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a0b29b945f44829bf3a233e37db090, user_id=db3d6effb7b34ad4afdfc9651b458e78, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:33.367094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665285f-6eec-40a6-a97f-165a655f21ad admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:33.390429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 810/1610] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:33.393164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.417167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 801/1611] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:33 2022] PUT /identity/v3/projects/07a0b29b945f44829bf3a233e37db090/users/db3d6effb7b34ad4afdfc9651b458e78/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:33.423731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7ffb-4881-480a-b6c4-a658cf0da33f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.424974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7ffb-4881-480a-b6c4-a658cf0da33f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.426050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7ffb-4881-480a-b6c4-a658cf0da33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.439121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47cc1d-f6db-479b-8c6a-69c90bcdfc40 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.479465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b84a7ffb-4881-480a-b6c4-a658cf0da33f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:33.483385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b84a7ffb-4881-480a-b6c4-a658cf0da33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:33.558607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:33.561274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.562316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.563081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.564810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:33.571244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:33.610147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 802/1612] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:33.612556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c164-3336-440c-a975-0de4087d0cd3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.612867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c164-3336-440c-a975-0de4087d0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.613134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c164-3336-440c-a975-0de4087d0cd3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.614964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 803/1613] 10.222.0.15 () {54 vars in 962 bytes} [Sun Aug 7 19:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:33.615500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683c164-3336-440c-a975-0de4087d0cd3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.647117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683c164-3336-440c-a975-0de4087d0cd3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.657234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 811/1614] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:33 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:33.659867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:33.666750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:33.668339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.671722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.672272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] PATH_INFO: `/v3/projects/1020680121304c50bfe476a8d85e651f/users/b79597e5db9e49b9931c1421216a8a14/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.712441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1020680121304c50bfe476a8d85e651f, user_id=b79597e5db9e49b9931c1421216a8a14, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:33.717532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5db1a-1370-403c-94b4-181a1ec5e5da admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:33.754300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 804/1615] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:33 2022] PUT /identity/v3/projects/1020680121304c50bfe476a8d85e651f/users/b79597e5db9e49b9931c1421216a8a14/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:33.756858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b957-3746-4f1c-9c69-dc6b474fa7b6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:33.761114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b957-3746-4f1c-9c69-dc6b474fa7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:33.761705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b957-3746-4f1c-9c69-dc6b474fa7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:33.805058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:33.810610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-76a2b957-3746-4f1c-9c69-dc6b474fa7b6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:33.815517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-76a2b957-3746-4f1c-9c69-dc6b474fa7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:33.874893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37666a2-b30e-498f-8fde-15703457e884 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:33.920664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:34.034561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.037187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.037844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.038488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.041645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 805/1616] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:34.044423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.051413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.051861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.115130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:34.120767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:34.187296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 806/1617] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Aug 7 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:34.191476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.210587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.214471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:34.251518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 812/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:34.253425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.306907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd4b63-e693-4b59-8332-4c4579a052e6 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:34.328887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.426829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.426829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.426829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.426829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.426829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3235a-994a-486e-8dde-66b7fae07012 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:34.457675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 813/1619] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:34 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:34.463011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0fefc-909f-4f01-ad95-83e0585c08c4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:34.469861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.470140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.470418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.476390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.477496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.477972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.478478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.519103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.521976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:34.554606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] MFA Rules not processed for user `b79597e5db9e49b9931c1421216a8a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:34.556033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:34.558834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 807/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:34.565036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.637606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b60db6-d8b0-47a7-b106-658bbfa8655e service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:34.646826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.649565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.650171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.651254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.667538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:34.695318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.702475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:34.744384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 808/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:34.746261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.763128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629feb57-e9a9-486a-989f-e446ff78a4b4 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:34.785213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 814/1622] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:34.787292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.794726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.796569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.796763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.797035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.827607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad86eea-8e90-48a8-940c-4cc1d4b37518 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:34.857129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:34.859236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:34.860266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:34.860982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:34.862512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.865905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:34.915634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 815/1623] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:34.918761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:34.987717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:34.991030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:35.057958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 809/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:35.059163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:35.125351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55094d-e337-4cfc-958a-2094245e69fc service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:35.149682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:35.152410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.154968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.155739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] PATH_INFO: `/v3/projects/0697d182f30540d198fea671f634035d/users/fc8939bb37d644af9a2ca4f7cac91fc6/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.215848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa3ac0-fb62-4777-869c-7df0bfd3d0b5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:35.226235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0697d182f30540d198fea671f634035d, user_id=fc8939bb37d644af9a2ca4f7cac91fc6, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:35.236181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:35.237980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daced1-ed3a-493d-a4e9-41d6c2f2e98a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:35.248516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.249319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.250762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.280154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 810/1625] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:35 2022] PUT /identity/v3/projects/0697d182f30540d198fea671f634035d/users/fc8939bb37d644af9a2ca4f7cac91fc6/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:35.280781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de708abe-8da0-4fa9-9602-ede5658867cb None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.281106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de708abe-8da0-4fa9-9602-ede5658867cb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.283839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de708abe-8da0-4fa9-9602-ede5658867cb None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.324815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:35.333827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47555297-9ead-4b43-9c8c-3a9ef4e19a41 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:35.338435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 811/1626] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 19:33:35 2022] GET /identity => generated 270 bytes in 60 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:35.347912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de708abe-8da0-4fa9-9602-ede5658867cb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:35.393576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 816/1627] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:35.396839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.397755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.398543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.466800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:35.473681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:35.562351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:35.706541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de708abe-8da0-4fa9-9602-ede5658867cb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:35.727660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:35.732064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.734260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.734927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.739938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:35.748547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:35.800480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 812/1628] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:35.806968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:35.843581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 817/1629] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:35.850354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f74f-b74e-4eac-bda4-054f0bc6e127 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:35.863957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:35.864723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.865072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.865357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] PATH_INFO: `/v3/projects/0697d182f30540d198fea671f634035d/users/fc8939bb37d644af9a2ca4f7cac91fc6/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:35.867144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:35.882702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0697d182f30540d198fea671f634035d, user_id=fc8939bb37d644af9a2ca4f7cac91fc6, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:35.892608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d379bd-eebb-40e1-9dd2-58e48a2b9a50 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:35.942086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 813/1630] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:35 2022] PUT /identity/v3/projects/0697d182f30540d198fea671f634035d/users/fc8939bb37d644af9a2ca4f7cac91fc6/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:35.962249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d557-a102-4968-b359-0f6d26e8f0d6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:35.962601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d557-a102-4968-b359-0f6d26e8f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:35.962800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d557-a102-4968-b359-0f6d26e8f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.035814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2ee6d557-a102-4968-b359-0f6d26e8f0d6 None None] MFA Rules not processed for user `fc8939bb37d644af9a2ca4f7cac91fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:36.040454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2ee6d557-a102-4968-b359-0f6d26e8f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:36.043429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563847cd-bdb8-44e8-91fa-2c07d3f5ea8b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:36.097021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:36.170768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:36.172512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:36.173506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:36.173506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.229922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 814/1631] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:36.231852 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f3bb-3d0d-44d9-9971-2a01a118184d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:36.235579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f3bb-3d0d-44d9-9971-2a01a118184d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:36.236606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f3bb-3d0d-44d9-9971-2a01a118184d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.240992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 815/1632] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 19:33:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:36.248038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:36.248861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:36.249259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.301168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:36.305168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:36.382224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:36.386633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:36.420454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 818/1633] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:33:36.499089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 816/1634] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:33:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:36.663415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:36.676211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b8ae-12f4-4d05-b94c-761cfe72b126 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:36.696849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:36.697894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:36.698405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:36.699661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.726875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:36.728911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:36.743944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 819/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:36.753701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:36.769243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45a01f-c00c-40eb-9778-e734d35c7fd8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:36.773701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:36.774212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:36.774489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:36.774756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:36.794516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:36.796801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:36.826074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 817/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:37.152664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:37.162900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8477ca1-beec-461f-8600-ed87362dfdc4 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:37.173362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:37.180724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:37.181364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:37.181632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:37.182869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:37.211271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:37.319070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18acb30-579e-41c4-88ef-1e53e3e0e5b2 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:37.326312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:37.327290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:37.327893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:37.328371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] PATH_INFO: `/v3/users/781069d6a33d45539639b4ff3cf22230` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:37.329867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] RBAC: Authorizing `identity:delete_user(user_id=781069d6a33d45539639b4ff3cf22230)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:37.332834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:37.456940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:37.465018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea2f2-12d9-43ee-a0d3-e42bfcc2abc8 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:37.468059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781069d6a33d45539639b4ff3cf22230'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:37.470866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781069d6a33d45539639b4ff3cf22230'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:37.473926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781069d6a33d45539639b4ff3cf22230'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:37.508305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781069d6a33d45539639b4ff3cf22230'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:37.545087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781069d6a33d45539639b4ff3cf22230'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:37.549473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 820/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:37.590340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 818/1638] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:37 2022] DELETE /identity/v3/users/781069d6a33d45539639b4ff3cf22230 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:37.593057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731e58a-18f5-45be-ae54-1dcad15a80c4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:37.593343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731e58a-18f5-45be-ae54-1dcad15a80c4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:37.593785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731e58a-18f5-45be-ae54-1dcad15a80c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:37.702627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f731e58a-18f5-45be-ae54-1dcad15a80c4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:37.707152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f731e58a-18f5-45be-ae54-1dcad15a80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:37.814654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:37.852371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 821/1639] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:37.879793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:37.892832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:38.115140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88523-ecdc-48a2-8d31-411cacd6866c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:38.121684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:38.123145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:38.123699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:38.124046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:38.139829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:38.141230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:38.155794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 819/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:38.460362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:38.461848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:38.462539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:38.546815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] MFA Rules not processed for user `db3d6effb7b34ad4afdfc9651b458e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:38.552534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:38.806194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 822/1641] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:38.807309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:38.810165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:38.863099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8bfd-eb0d-4197-a618-4b02d404ea24 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:38.889329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:38.890426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:38.890921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:38.891488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:38.892682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:38.898891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:39.007871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 820/1642] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:38 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:39.009268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:39.024707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90314f-d88f-415f-b9b6-40b4b905c237 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:39.173975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:39.174683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:39.175178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:39.175394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:39.176100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:39.178888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:39.263436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 823/1643] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:39 2022] POST /identity/v3/users => generated 309 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:39.265712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:39.293922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da8ef-87af-40dc-90e3-6e6df77e9869 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:39.350372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:39.351683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:39.352147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:39.352623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:39.353862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:39.363793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:39.439395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:39.454926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 821/1644] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:39.478595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692a29-1222-4e8e-95b3-f9a27257bed9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:39.509644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:39.510800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:39.511305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:39.511803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] PATH_INFO: `/v3/projects/0ae1816ceece4894ac10f0d44db257c7/users/b0ffaaa4d29b48ffab63a0eefc72e4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:39.600985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae1816ceece4894ac10f0d44db257c7, user_id=b0ffaaa4d29b48ffab63a0eefc72e4da, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:39.625628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:39.682547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 824/1645] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:39 2022] PUT /identity/v3/projects/0ae1816ceece4894ac10f0d44db257c7/users/b0ffaaa4d29b48ffab63a0eefc72e4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:39.685424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:39.737996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734946-1009-4412-99e6-1cfd9d21a8e4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:39.761267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:40.001906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:40.003679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:40.003963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:40.008455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:40.010441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:40.017056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:40.051102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 822/1646] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:40.055721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:40.072079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa908-c232-4bb7-ae04-3144b55dee02 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:40.111059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:40.112136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:40.112580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:40.113003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] PATH_INFO: `/v3/projects/0ae1816ceece4894ac10f0d44db257c7/users/b0ffaaa4d29b48ffab63a0eefc72e4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:40.118611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae1816ceece4894ac10f0d44db257c7, user_id=b0ffaaa4d29b48ffab63a0eefc72e4da, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:40.122040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:40.196920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 825/1647] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:40 2022] PUT /identity/v3/projects/0ae1816ceece4894ac10f0d44db257c7/users/b0ffaaa4d29b48ffab63a0eefc72e4da/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:40.350804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:40.354555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:40.418970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db82e5-d3fb-468d-a0b8-4ebab052625c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:40.713497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:40.715640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:40.716066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:40.717831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] PATH_INFO: `/v3/projects/ae87904bb46448e692c6999107b920d1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:40.723064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae87904bb46448e692c6999107b920d1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:40.727330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: WARNING py.warnings [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:40.727330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: warnings.warn(msg) Aug 07 19:33:40.727330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: Aug 07 19:33:40.734380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:40.861576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:40.866342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:40.934069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9219e3-a2fa-4f89-a710-77bb865e2ac0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:40.951469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae87904bb46448e692c6999107b920d1', 'request_id': 'req-707bb334-06d5-48aa-84c9-981d51c33a8e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.004471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae87904bb46448e692c6999107b920d1', 'request_id': 'req-707bb334-06d5-48aa-84c9-981d51c33a8e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.031264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae87904bb46448e692c6999107b920d1', 'request_id': 'req-707bb334-06d5-48aa-84c9-981d51c33a8e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.055700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] The token cache is being invalidate because project ae87904bb46448e692c6999107b920d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:41.056719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.057723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-707bb334-06d5-48aa-84c9-981d51c33a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.065560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 823/1648] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:40 2022] DELETE /identity/v3/projects/ae87904bb46448e692c6999107b920d1 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:41.068931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e9cf-fbb6-4ef1-885e-5f1815520616 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.071419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e9cf-fbb6-4ef1-885e-5f1815520616 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.071876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630e9cf-fbb6-4ef1-885e-5f1815520616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.108702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:41.125681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6630e9cf-fbb6-4ef1-885e-5f1815520616 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:41.127304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6630e9cf-fbb6-4ef1-885e-5f1815520616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:41.226931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:41.232600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:41.233965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.234439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.234919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] PATH_INFO: `/v3/users/b2991e420f3644feb5a0f2528b34cfd6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.242784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2991e420f3644feb5a0f2528b34cfd6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:41.245253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 19:33:41.245253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: warnings.warn(msg) Aug 07 19:33:41.245253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: Aug 07 19:33:41.254065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:41.323320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 824/1649] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:41.331618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.332219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.332715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.379629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:41.381073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:41.402220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 825/1650] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:41.406845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:41.425393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1135a5c-38e6-4744-ae37-d523bacf7776 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:41.441313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:41.441801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.442987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.443506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.447897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:41.449300 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:41.454754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:41.508164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 826/1651] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:33:41.509619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:41.529226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29214108-963a-404c-a026-ac309b8abfb8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:41.536895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:41.537828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.539054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.540356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.541363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:41.547118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:41.574884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2991e420f3644feb5a0f2528b34cfd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.576208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2991e420f3644feb5a0f2528b34cfd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.578257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2991e420f3644feb5a0f2528b34cfd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.637470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 827/1652] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:41 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:41.644329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:41.653978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:41.654783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2991e420f3644feb5a0f2528b34cfd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.675786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-146cc186-0b57-4e38-8e13-6da289ce37c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2991e420f3644feb5a0f2528b34cfd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:41.724166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 826/1653] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:40 2022] DELETE /identity/v3/users/b2991e420f3644feb5a0f2528b34cfd6 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:41.734135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.734640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.734925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.796385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:41.800768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:41.849974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86a19-d504-4807-8f91-533b8809b3a2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:41.984784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:41.985623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:41.986411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:41.986768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:41.993378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:41.999959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:42.030043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 827/1654] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:42.065755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:42.067795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:42.099042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 828/1655] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:41 2022] POST /identity/v3/users => generated 288 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:42.101472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:42.136817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862d5b7-db5a-4576-bea4-ecfc41009a17 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:42.152745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:42.155521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.156228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.158425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.159889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:42.169960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:42.197456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911e6d3-96b5-4971-bf6f-794a660be47e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:42.201502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:42.202311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.202587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.204623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.213420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 829/1656] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:42.215335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:42.218501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:42.221592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:42.223373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:42.230756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a58d-5860-4445-a559-d10fa848e78a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:42.237016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 828/1657] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:33:42.238581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:42.240083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.240529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.241236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.242708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:42.245946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605f117-9887-47e6-837f-463f8a5a3dbb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:42.309256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:42.316464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 830/1658] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:42.329432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00277-d150-421d-a29c-57de36f32ece service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:42.349586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:42.350303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.350565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.350836 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] PATH_INFO: `/v3/projects/d4d8c2d6a68e4f1995bfc7de4608334c/users/bd33a0986d834b788102badb287a0b66/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.394130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d8c2d6a68e4f1995bfc7de4608334c, user_id=bd33a0986d834b788102badb287a0b66, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:42.404702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:42.462509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 829/1659] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:42 2022] PUT /identity/v3/projects/d4d8c2d6a68e4f1995bfc7de4608334c/users/bd33a0986d834b788102badb287a0b66/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:42.466552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.466805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.466956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.504270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:42.562787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] MFA Rules not processed for user `bd33a0986d834b788102badb287a0b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:42.566390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:42.775983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 831/1660] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:42.781325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:42.966792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6d3a-390a-47ec-9352-fbcf2d4d5a24 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:42.988932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:42.989680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:42.989997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:42.990334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:42.991016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:42.993992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.070891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 830/1661] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:42 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:43.075070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:43.092044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c527-1502-4d4a-bbd5-bf2619ce362d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:43.235162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:43.236779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.239211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.239781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.242267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:43.245225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.293889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 832/1662] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:43 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:33:43.299655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:43.334415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84a1e-53f9-4a81-bcb0-e4c56e9470d4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:43.360280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:43.361315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.362470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.363000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.364396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:43.366684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.389158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 831/1663] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:43.393549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:43.412409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0d6c-c771-470d-9b85-71bb453b11fa admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:43.430961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:43.431929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.432410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.432874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] PATH_INFO: `/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88/users/32217acff7db47c3b313b0aa0a2cf4aa/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.475915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cbe1fbd7db40a7a5c8e46fee50ca88, user_id=32217acff7db47c3b313b0aa0a2cf4aa, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:43.485029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.525475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 833/1664] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:43 2022] PUT /identity/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88/users/32217acff7db47c3b313b0aa0a2cf4aa/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:43.526913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:43.541552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806e89-4a50-41fc-9f02-7d4dc7af4392 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:43.709708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:43.710374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.710648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.710918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.711652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:43.713365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ac1ad-15b4-46be-8738-c4ae94417f26 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.745199 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:43.747915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 832/1665] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:43.760630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937c813-a4b2-4828-beda-6156979236e4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:43.773475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:43.774425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.774701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.774973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] PATH_INFO: `/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88/users/32217acff7db47c3b313b0aa0a2cf4aa/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.787487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cbe1fbd7db40a7a5c8e46fee50ca88, user_id=32217acff7db47c3b313b0aa0a2cf4aa, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:43.790355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df98d3-d976-45f6-931f-1d12cc962bcc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:43.835713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 834/1666] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:43 2022] PUT /identity/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88/users/32217acff7db47c3b313b0aa0a2cf4aa/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:43.847269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:43.847269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:43.847894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:43.978651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] MFA Rules not processed for user `32217acff7db47c3b313b0aa0a2cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:43.981936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:44.089922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:44.185496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff868bd-e10f-449e-b1b5-96347a413853 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:44.185990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff868bd-e10f-449e-b1b5-96347a413853 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:44.186488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff868bd-e10f-449e-b1b5-96347a413853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:44.244571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 833/1667] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:44.260481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:44.270966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:44.349294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dff868bd-e10f-449e-b1b5-96347a413853 None None] MFA Rules not processed for user `b0ffaaa4d29b48ffab63a0eefc72e4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:44.380856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dff868bd-e10f-449e-b1b5-96347a413853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:44.505536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac646e6-7c14-4bf6-9c7e-ff272d2fcb8b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:44.514627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:44.515323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:44.515599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:44.518445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:44.567034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:44.671628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:44.673400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:44.694290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 834/1668] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:44.701919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:44.703777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 835/1669] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:44.720044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:44.922016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2517f-4c76-42dc-8315-4f5ae19b0a0b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:44.942053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:44.942757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:44.943018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:44.943310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] PATH_INFO: `/v3/projects/0f6a41378f1b490fa7d707645929316e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:44.945688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6a41378f1b490fa7d707645929316e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:44.947919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:45.022255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:45.077083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6a41378f1b490fa7d707645929316e', 'request_id': 'req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:45.096835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6a41378f1b490fa7d707645929316e', 'request_id': 'req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:45.117796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6a41378f1b490fa7d707645929316e', 'request_id': 'req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:45.154395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] The token cache is being invalidate because project 0f6a41378f1b490fa7d707645929316e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:45.154615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:45.155457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b793cdf0-cbf8-4f4e-98a4-10ef49d7cd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:45.160863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 835/1670] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:44 2022] DELETE /identity/v3/projects/0f6a41378f1b490fa7d707645929316e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:45.169562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:45.170084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:45.170528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:45.263716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:45.270789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:45.496242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 836/1671] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:45.508581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:45.510643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:45.510643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:45.557769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:45.559130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:45.592973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 836/1672] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:45.599282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:45.620839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8b98-a840-42d5-be9a-af5f4adcfa1f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:45.641291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:45.642291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:45.642774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:45.643267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:45.644247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:45.644737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:45.646849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:45.703731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:45.711540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 837/1673] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:45.723875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24581920-8ccb-4a2f-a783-8792385a81fc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:45.743983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:45.744741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:45.744888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:45.747465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:45.748193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:45.759536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:45.841092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 837/1674] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:45 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:33:45.845993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:45.898717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01088-6058-4d40-81cd-ecfa65c0eed5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:46.171025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:46.173356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:46.174005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:46.174693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:46.175827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:46.180041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:46.240569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 838/1675] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:45 2022] POST /identity/v3/users => generated 282 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:46.244375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:46.271854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bae5-7834-4ad7-a0e2-e17252230bca admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:46.281430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:46.282300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:46.282738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:46.283877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:46.285588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:46.288952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:46.332376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:46.334472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 838/1676] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:46.351914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca252b4-c775-4099-bebc-382b1778e995 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:46.375748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:46.376458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:46.376733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:46.377008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:46.377739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:46.379536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471baea-6954-4cd5-afb2-a7ad8cdab90c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:46.405737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 839/1677] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:33:46.407883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:46.453065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29ad14-f606-4801-ad4d-f01a27a70578 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:46.469970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:46.479697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:46.479697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:46.479697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] PATH_INFO: `/v3/projects/cfe58d13bcaf437ba38cf63c6154eda1/users/9e3f067c5af04dd1a4e36f142b010c2d/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:46.557714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe58d13bcaf437ba38cf63c6154eda1, user_id=9e3f067c5af04dd1a4e36f142b010c2d, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:46.568676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:46.614064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 839/1678] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:46 2022] PUT /identity/v3/projects/cfe58d13bcaf437ba38cf63c6154eda1/users/9e3f067c5af04dd1a4e36f142b010c2d/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:46.620821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:46.623498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:46.624666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:46.704161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] MFA Rules not processed for user `9e3f067c5af04dd1a4e36f142b010c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:46.706508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:46.828912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:46.990494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 840/1679] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:46.992382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:47.157088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba694594-71fe-46b6-9cea-46a55bd4932b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:47.189112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:47.190161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:47.190702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:47.191180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:47.192090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:47.194866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c8abd-8267-4572-8b22-5eb2f55cd3ed admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:47.338740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 840/1680] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:46 2022] POST /identity/v3/projects => generated 365 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:47.339780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:47.394212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:47.394886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:47.395520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:47.424023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551979e-e64f-4abe-a33a-d68cc26191f4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:47.546735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] MFA Rules not processed for user `26adbd5487f0466d9b36adc4d6f768dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:47.552132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:47.654627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:47.753178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:47.754239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:47.754706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:47.755170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:47.756075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:47.758570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:47.866854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 841/1681] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:47 2022] POST /identity/v3/users => generated 289 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:47.871387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:47.913313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182c10f-1225-4528-83f8-9a56ab29070a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:47.919221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 841/1682] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:47.947681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:47.948860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:47.949364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:47.949829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:47.950044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:47.953280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:47.953574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:47.960435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:48.016913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 842/1683] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:48.018599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:48.061962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf3e4-e3db-4a67-a17e-db4eca5c49f6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:48.082812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:48.083897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.084360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.084828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] PATH_INFO: `/v3/projects/12053bc76f5f40ff914e9ee305cb249d/users/8c988105dae14aefa96b802b9e40bbcf/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:48.128095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12053bc76f5f40ff914e9ee305cb249d, user_id=8c988105dae14aefa96b802b9e40bbcf, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:48.134477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:48.171005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 843/1684] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:48 2022] PUT /identity/v3/projects/12053bc76f5f40ff914e9ee305cb249d/users/8c988105dae14aefa96b802b9e40bbcf/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:48.172549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:48.374186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4bf6-88af-428a-a5fe-2e0b9b89ba67 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:48.443062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10f2c-4dc2-4e4f-a190-e5222f561280 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:48.468183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:48.471745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.475164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.477546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:48.482147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:48.486008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:48.512509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 844/1685] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:48.515242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:48.558685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa260-1d73-4acd-86b7-e1e52203b9da admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:48.581730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:48.582843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.583340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.583809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] PATH_INFO: `/v3/projects/12053bc76f5f40ff914e9ee305cb249d/users/8c988105dae14aefa96b802b9e40bbcf/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:48.611460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12053bc76f5f40ff914e9ee305cb249d, user_id=8c988105dae14aefa96b802b9e40bbcf, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:48.621939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:48.659230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 845/1686] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:33:48 2022] PUT /identity/v3/projects/12053bc76f5f40ff914e9ee305cb249d/users/8c988105dae14aefa96b802b9e40bbcf/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:48.659230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:48.659230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:48.701161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:48.702342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.702921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.703548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:48.712809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:48.868469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3a92-4f7b-44cd-b2e5-f50bb721157d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:48.876184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:48.877640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.878301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.879431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:48.883426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:48.932715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:48.934581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0c5ac-db49-4a54-b2ed-ba15c2fc5095 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:48.939431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:48.971566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 842/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 1023 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:33:48.978272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff08e6-66be-49e1-b269-8689c202fe6d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:48.978802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff08e6-66be-49e1-b269-8689c202fe6d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:48.981162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff08e6-66be-49e1-b269-8689c202fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:49.098820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:49.103130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:49.113458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9bff08e6-66be-49e1-b269-8689c202fe6d None None] MFA Rules not processed for user `8c988105dae14aefa96b802b9e40bbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:49.115637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9bff08e6-66be-49e1-b269-8689c202fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:49.147588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 846/1688] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:49.313767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 843/1689] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:49.383918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:49.398541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e907af2-6ab1-404e-9eff-7d25707dd625 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:49.405124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:49.406096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:49.406695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:49.407282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:49.441846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:49.447523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a10c7-f6d3-4005-9a6b-6d77b0ffa421 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:49.470438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 847/1690] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:49.855215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308d24-a53f-443f-a0c4-6c613e50b100 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:49.855834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308d24-a53f-443f-a0c4-6c613e50b100 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:49.856486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308d24-a53f-443f-a0c4-6c613e50b100 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:49.859859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 844/1691] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:33:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:49.872069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0767c0-2839-41a0-bdf1-5fd935396a08 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:49.872912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0767c0-2839-41a0-bdf1-5fd935396a08 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:49.873336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0767c0-2839-41a0-bdf1-5fd935396a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:49.953793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7b0767c0-2839-41a0-bdf1-5fd935396a08 None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:49.956450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7b0767c0-2839-41a0-bdf1-5fd935396a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:50.155937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 848/1692] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:50.201766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcaf34-7466-4e1a-8e7a-668667ba25cd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:50.202540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcaf34-7466-4e1a-8e7a-668667ba25cd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:50.203071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcaf34-7466-4e1a-8e7a-668667ba25cd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:50.206715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 845/1693] 10.222.0.15 () {54 vars in 961 bytes} [Sun Aug 7 19:33:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:50.215441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:50.215780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:50.216015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:50.260323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:50.265568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:50.290409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 849/1694] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Aug 7 19:33:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:50.300855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcaf34-7466-4e1a-8e7a-668667ba25cd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:50.334654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcaf34-7466-4e1a-8e7a-668667ba25cd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:50.352131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:50.352886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:50.353915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:50.354217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:50.377299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:50.380846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b99b-5248-4760-a77a-785a45e80a6f service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:50.438578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 846/1695] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:50.891992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:50.957735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:51.061083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a31f3-0015-4b0f-a315-2e262d6d014b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:51.066341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:51.067045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:51.067355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:51.067634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] PATH_INFO: `/v3/users/9e3f067c5af04dd1a4e36f142b010c2d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:51.071020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3f067c5af04dd1a4e36f142b010c2d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:51.073698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:51.214622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3f067c5af04dd1a4e36f142b010c2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:51.216996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3f067c5af04dd1a4e36f142b010c2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:51.219480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3f067c5af04dd1a4e36f142b010c2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:51.230284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3f067c5af04dd1a4e36f142b010c2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:51.249168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3f067c5af04dd1a4e36f142b010c2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:51.272358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 850/1696] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:50 2022] DELETE /identity/v3/users/9e3f067c5af04dd1a4e36f142b010c2d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:51.277417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-9600-4ade-8c49-924733d4c392 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:51.278716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-9600-4ade-8c49-924733d4c392 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:51.280887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-9600-4ade-8c49-924733d4c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:51.320158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b9c0c6f2-9600-4ade-8c49-924733d4c392 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:51.322711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b9c0c6f2-9600-4ade-8c49-924733d4c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:51.529918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 847/1697] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:33:51.565828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:51.569569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:51.630667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:51.630948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:51.631416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:51.688511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] MFA Rules not processed for user `9a1411b0bd2449708c5be668586b777c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:51.692656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:51.760489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4c99d-f3b5-49c3-9825-69ffd5654740 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:51.774805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:51.775538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:51.775782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:51.776074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:51.795090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:51.797871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa41ad-c204-48f0-9b7e-ba91bf4ac5db service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:51.827547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 851/1698] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:51.852015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:51.865486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 848/1699] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:33:51.879864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c488b6-514c-4827-9a51-03192987357a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:51.880865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c488b6-514c-4827-9a51-03192987357a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:51.881412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c488b6-514c-4827-9a51-03192987357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:51.928831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-29c488b6-514c-4827-9a51-03192987357a None None] MFA Rules not processed for user `9a1411b0bd2449708c5be668586b777c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:51.937284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-29c488b6-514c-4827-9a51-03192987357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:51.961895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 852/1700] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:51.995349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:51.998400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:52.319588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146cce-8a9f-4ecd-baef-90d20911b87d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:52.340233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:52.340883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:52.341386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:52.341671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:52.375061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:52.379712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7685fb-16fa-4fa3-b1d5-f385ff619aa0 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:52.434735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 849/1701] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:52.568126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:52.568402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:52.569086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:52.584047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 853/1702] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:33:52 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:52.670564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:52.672204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:52.672899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:52.715008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] MFA Rules not processed for user `a3f7750b5c4740b4bf56933e2c7bbfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:52.716315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:52.780639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:52.782493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:52.836558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d28d-a2b6-434d-88ec-e4e11c023079 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:52.849198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:52.850099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:52.850406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:52.850666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] PATH_INFO: `/v3/users/db3d6effb7b34ad4afdfc9651b458e78` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:52.852318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3d6effb7b34ad4afdfc9651b458e78)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:52.855043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:52.879512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 850/1703] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:53.033470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:53.040888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3d6effb7b34ad4afdfc9651b458e78'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.043022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3d6effb7b34ad4afdfc9651b458e78'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.043180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:53.045071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.046521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3d6effb7b34ad4afdfc9651b458e78'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.069345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3d6effb7b34ad4afdfc9651b458e78'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.103454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3d6effb7b34ad4afdfc9651b458e78'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.130657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 854/1704] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:52 2022] DELETE /identity/v3/users/db3d6effb7b34ad4afdfc9651b458e78 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:53.136979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8821-63c5-4214-8fd9-ea7989cf472a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:53.216246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:53.218567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.310333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:53.311057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:53.311370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:53.311723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:53.319041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.358022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:53.366315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:53.394335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 851/1705] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:33:53.483167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953422e-bd98-4196-9ad0-b473f4eb61ae admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:53.498326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:53.499041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:53.499357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:53.499681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] PATH_INFO: `/v3/users/b79597e5db9e49b9931c1421216a8a14` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:53.505375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79597e5db9e49b9931c1421216a8a14)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:53.507456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:53.626470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:53.628685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.639868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79597e5db9e49b9931c1421216a8a14'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.642930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79597e5db9e49b9931c1421216a8a14'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.644231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79597e5db9e49b9931c1421216a8a14'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.654379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5e28-94aa-4e1c-b01b-f493b653305f service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:53.664004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:53.665944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:53.666506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:53.666634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79597e5db9e49b9931c1421216a8a14'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.667683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] PATH_INFO: `/v3/projects/cfe58d13bcaf437ba38cf63c6154eda1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:53.676976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe58d13bcaf437ba38cf63c6154eda1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:53.682379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:53.725048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-391fa12b-fb50-47b5-9b08-e9d40c21f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79597e5db9e49b9931c1421216a8a14'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.731777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:53.770338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 855/1706] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:53 2022] DELETE /identity/v3/users/b79597e5db9e49b9931c1421216a8a14 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:53.775697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:53.775995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:53.776294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:53.826834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:53.829054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.839997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe58d13bcaf437ba38cf63c6154eda1', 'request_id': 'req-dbc361ed-c22d-4354-b0f0-96b15517022a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.851864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe58d13bcaf437ba38cf63c6154eda1', 'request_id': 'req-dbc361ed-c22d-4354-b0f0-96b15517022a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.879580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe58d13bcaf437ba38cf63c6154eda1', 'request_id': 'req-dbc361ed-c22d-4354-b0f0-96b15517022a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.898235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] The token cache is being invalidate because project cfe58d13bcaf437ba38cf63c6154eda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:53.898235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.899512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:53.904687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 852/1707] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:53 2022] DELETE /identity/v3/projects/cfe58d13bcaf437ba38cf63c6154eda1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:33:53.909087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:53.912079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:53.917737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:53.963130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 856/1708] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:53.992060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:53.994397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:54.096012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc361ed-c22d-4354-b0f0-96b15517022a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:54.111892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:54.112937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:54.113388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:54.113794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] PATH_INFO: `/v3/users/8c988105dae14aefa96b802b9e40bbcf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:54.117804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c988105dae14aefa96b802b9e40bbcf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:54.121643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:54.209012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe584656-87d9-4d00-b1a6-5a5d12ad19cc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:54.217776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:54.219055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:54.224047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:54.225252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:54.247935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:54.248615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d0302-6683-4703-8efb-644d62335d9f service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:54.254682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c988105dae14aefa96b802b9e40bbcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:54.256678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c988105dae14aefa96b802b9e40bbcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:54.257713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c988105dae14aefa96b802b9e40bbcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:54.274789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 857/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:54.280459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c988105dae14aefa96b802b9e40bbcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:54.294118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f4a44794-43d5-419b-b8eb-771ed93d267a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c988105dae14aefa96b802b9e40bbcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:54.333238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 853/1710] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:53 2022] DELETE /identity/v3/users/8c988105dae14aefa96b802b9e40bbcf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:54.803089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:54.803919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:54.804192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:54.806548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 858/1711] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 19:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:54.821627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:54.822446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:54.822446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:54.874642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:54.913506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:54.914848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:54.954446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:54.956628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:55.150200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 854/1712] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:55.200194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630785d-42f1-46eb-b534-b93ffed2b961 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:55.207226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:55.210388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:55.220185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:55.224179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:55.225963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:55.226406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] PATH_INFO: `/v3/projects/07a0b29b945f44829bf3a233e37db090` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:55.233466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a0b29b945f44829bf3a233e37db090)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:55.248746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:55.276732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016bfac-c865-415b-b3da-0615f31e5ada None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:55.291816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:55.293077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:55.295010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:55.295493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:55.321078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:55.330296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:55.355525 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 855/1713] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:55.402652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a0b29b945f44829bf3a233e37db090', 'request_id': 'req-2e0f0109-6187-4d90-aad3-015b6cede6bf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.412110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a0b29b945f44829bf3a233e37db090', 'request_id': 'req-2e0f0109-6187-4d90-aad3-015b6cede6bf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.434194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a0b29b945f44829bf3a233e37db090', 'request_id': 'req-2e0f0109-6187-4d90-aad3-015b6cede6bf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.457593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] The token cache is being invalidate because project 07a0b29b945f44829bf3a233e37db090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:55.457924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.459223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e0f0109-6187-4d90-aad3-015b6cede6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.467378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:55.468129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 859/1714] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:54 2022] DELETE /identity/v3/projects/07a0b29b945f44829bf3a233e37db090 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:55.506416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7665-b95f-442b-96d7-86046910c302 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:55.754556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:55.755911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:55.756723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:55.757199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] PATH_INFO: `/v3/users/b0ffaaa4d29b48ffab63a0eefc72e4da` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:55.758845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ffaaa4d29b48ffab63a0eefc72e4da)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:55.761497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:55.905257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ffaaa4d29b48ffab63a0eefc72e4da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.905993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ffaaa4d29b48ffab63a0eefc72e4da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.908820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ffaaa4d29b48ffab63a0eefc72e4da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.943072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ffaaa4d29b48ffab63a0eefc72e4da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:55.970458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8433762f-af5f-47fe-942d-6cfc91ae54ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ffaaa4d29b48ffab63a0eefc72e4da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:56.001952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 856/1715] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:33:55 2022] DELETE /identity/v3/users/b0ffaaa4d29b48ffab63a0eefc72e4da => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:56.056906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:56.057504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:56.057899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:56.114356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] MFA Rules not processed for user `26adbd5487f0466d9b36adc4d6f768dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:56.125129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:56.161160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:56.299849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:56.299849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:56.300376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:56.447308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] MFA Rules not processed for user `cd53375218ec492e8e250efe42b3d09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:56.448988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:56.471351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 860/1716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:56.478292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:56.488547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:56.492421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:56.795223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 857/1717] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:33:56.795223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:56.795223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:56.922424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215c7f-d328-4cf8-88aa-bca26b6f3d1d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:56.937214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:56.937936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:56.938214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:56.938488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] PATH_INFO: `/v3/projects/12053bc76f5f40ff914e9ee305cb249d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:56.940904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12053bc76f5f40ff914e9ee305cb249d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:56.942903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:57.058024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc38959-3c50-43ef-b620-f8854742fb7b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:57.128961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12053bc76f5f40ff914e9ee305cb249d', 'request_id': 'req-87c72255-7613-4427-83bd-33c1f089d2d1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.140772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12053bc76f5f40ff914e9ee305cb249d', 'request_id': 'req-87c72255-7613-4427-83bd-33c1f089d2d1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.167372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12053bc76f5f40ff914e9ee305cb249d', 'request_id': 'req-87c72255-7613-4427-83bd-33c1f089d2d1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.209869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] The token cache is being invalidate because project 12053bc76f5f40ff914e9ee305cb249d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:57.227675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.228986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.231942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 861/1718] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:56 2022] DELETE /identity/v3/projects/12053bc76f5f40ff914e9ee305cb249d => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:57.241322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:57.247276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:57.322222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:57.322903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:57.323180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:57.323530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] PATH_INFO: `/v3/projects/1020680121304c50bfe476a8d85e651f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:57.336089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1020680121304c50bfe476a8d85e651f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:57.347165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:57.442464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:57.487707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72255-7613-4427-83bd-33c1f089d2d1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:57.490932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1020680121304c50bfe476a8d85e651f', 'request_id': 'req-1da08485-cfbb-4836-b303-b785d46b2dcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.530881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1020680121304c50bfe476a8d85e651f', 'request_id': 'req-1da08485-cfbb-4836-b303-b785d46b2dcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.533735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:57.560750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1020680121304c50bfe476a8d85e651f', 'request_id': 'req-1da08485-cfbb-4836-b303-b785d46b2dcf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.606802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] The token cache is being invalidate because project 1020680121304c50bfe476a8d85e651f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:57.607689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.610285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1da08485-cfbb-4836-b303-b785d46b2dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.617072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 858/1719] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:56 2022] DELETE /identity/v3/projects/1020680121304c50bfe476a8d85e651f => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:57.619888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89c10-84e3-43e1-8ddc-fd206c9bbfa7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:57.624168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89c10-84e3-43e1-8ddc-fd206c9bbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:57.627036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89c10-84e3-43e1-8ddc-fd206c9bbfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:57.676884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:57.678066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:57.678756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:57.679183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] PATH_INFO: `/v3/projects/0ae1816ceece4894ac10f0d44db257c7` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:57.682120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae1816ceece4894ac10f0d44db257c7)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:57.685825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:57.745545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-58a89c10-84e3-43e1-8ddc-fd206c9bbfa7 None None] MFA Rules not processed for user `cd53375218ec492e8e250efe42b3d09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:57.747017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58a89c10-84e3-43e1-8ddc-fd206c9bbfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:57.856742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae1816ceece4894ac10f0d44db257c7', 'request_id': 'req-7ae8370d-7893-4f2e-a0dc-562983c17d74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.886726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae1816ceece4894ac10f0d44db257c7', 'request_id': 'req-7ae8370d-7893-4f2e-a0dc-562983c17d74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.907843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae1816ceece4894ac10f0d44db257c7', 'request_id': 'req-7ae8370d-7893-4f2e-a0dc-562983c17d74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.931589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] The token cache is being invalidate because project 0ae1816ceece4894ac10f0d44db257c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:33:57.931829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.937525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:33:57.940575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 862/1720] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:33:57 2022] DELETE /identity/v3/projects/0ae1816ceece4894ac10f0d44db257c7 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:33:57.953400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:57.957127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:57.990254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 859/1721] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:57.992746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc903-b2f7-4674-8e62-bce16761ef63 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:57.993202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc903-b2f7-4674-8e62-bce16761ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:57.993676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc903-b2f7-4674-8e62-bce16761ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.084356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ae6cc903-b2f7-4674-8e62-bce16761ef63 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.086719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae6cc903-b2f7-4674-8e62-bce16761ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.131090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8370d-7893-4f2e-a0dc-562983c17d74 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:58.146450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:58.148048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.148975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.149500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.152541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.177466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:58.180228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4b3e-35ea-466a-a204-f9d5ba0cdd53 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:58.212975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 863/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:58.240868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.241644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.241934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.341037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.344385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.388470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 860/1723] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.389881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658835f-c1f2-49f9-bb50-84637d106dfd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.390169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658835f-c1f2-49f9-bb50-84637d106dfd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.390443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658835f-c1f2-49f9-bb50-84637d106dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.418808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 864/1724] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.420345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:58.424029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.447456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1658835f-c1f2-49f9-bb50-84637d106dfd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.449686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1658835f-c1f2-49f9-bb50-84637d106dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.460497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 861/1725] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.462265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bf5d-a16e-4d7f-bed0-ffd9a73f464a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.462784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bf5d-a16e-4d7f-bed0-ffd9a73f464a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.463320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bf5d-a16e-4d7f-bed0-ffd9a73f464a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.465260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 862/1726] 10.222.0.15 () {54 vars in 912 bytes} [Sun Aug 7 19:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:33:58.466817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0eb26-e0a1-4d76-8dde-67f7418d1fe5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.467374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0eb26-e0a1-4d76-8dde-67f7418d1fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.467843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0eb26-e0a1-4d76-8dde-67f7418d1fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.470818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:58.494657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-84f0eb26-e0a1-4d76-8dde-67f7418d1fe5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.496218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-84f0eb26-e0a1-4d76-8dde-67f7418d1fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.508285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 863/1727] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.509986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a8b-3b85-4f2a-9433-ec1664ac83b9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.510508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a8b-3b85-4f2a-9433-ec1664ac83b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.511013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a8b-3b85-4f2a-9433-ec1664ac83b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.570398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ab7a6a8b-3b85-4f2a-9433-ec1664ac83b9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.572521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ab7a6a8b-3b85-4f2a-9433-ec1664ac83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.596316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 864/1728] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.598785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f4f3-1878-4ef3-938e-88b8f06087d3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.599427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f4f3-1878-4ef3-938e-88b8f06087d3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.599878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f4f3-1878-4ef3-938e-88b8f06087d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.626789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0e605-ca19-41e8-aa1c-c77f79ae9b1f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:58.634084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:58.635008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.635425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.635793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.637874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.668450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d1a3f4f3-1878-4ef3-938e-88b8f06087d3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.673846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d1a3f4f3-1878-4ef3-938e-88b8f06087d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.700896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 865/1729] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.703658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.704321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.705026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.828657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:58.830399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:58.845054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:33:58.846503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:58.862627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 865/1730] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:58.871655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:58.907794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892599-1a4d-49e8-bde7-5c3d0090d42f service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:58.926856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:58.931354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.931754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.932031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:58.932747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:58.933049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:58.943160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:58.948394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 866/1731] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:33:58.949875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:58.968715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2b50-93ab-44fb-81e5-f6251a1d5ec7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:58.993105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:58.994351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:58.994675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:58.998884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.013858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:59.014082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 866/1732] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:59.014484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.017692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.029283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.056156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:59.072069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b21d30-df62-4329-a516-6d110c65fec0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.079712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 867/1733] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:59.080696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.089412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:33:59.093490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.098409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.098728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.101777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.103246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:33:59.105648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.111046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.132838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aaef-af3a-48c9-a44a-f8a13be5e2cd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.140155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.141146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.143831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.143831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.153155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 867/1734] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:33:59.155454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.164601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.171940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.193487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb14d-7f1d-412f-a56a-03cbe05e70bc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.218065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 868/1735] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:33:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:33:59.219131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.225476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.229063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.229350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.229629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.230316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.246149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.248911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475ed86-652d-47f6-9249-758bc0411b66 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.260486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.261328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.261704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.262077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.263003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.267545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.350458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 869/1736] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:59 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:59.351682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.393851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 868/1737] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:59 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:59.399784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.608919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177ab4e-2535-4b8e-b162-f5a0fefafbd8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.640920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:33:59.655138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403223-b5b9-46cb-86d0-b88f5d148738 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.675544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.677209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.691482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.691887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.692599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.701408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.761620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 869/1738] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:59 2022] POST /identity/v3/users => generated 303 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:59.762945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.787896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e4dbd-34aa-456e-83c8-9d60e1fca3b1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.801484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.803351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.803661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.803938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.807096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.813056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.869873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 870/1739] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:33:59 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:33:59.870928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.899351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.900272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.901018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.901018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.901732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.907694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.907902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff137e9-213b-4631-8088-bfa33b78475c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.913327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.913985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.915227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.915227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.915457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.917041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:33:59.930307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 871/1740] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:33:59.931665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:33:59.964593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41cbd1-ad97-4212-8e10-ce9f123581ff admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:33:59.976382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:33:59.978126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:33:59.978126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:33:59.978421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:33:59.978946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:33:59.982461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.015524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 872/1741] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:00.015524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.020114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 870/1742] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:33:59 2022] POST /identity/v3/projects => generated 381 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:00.021675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.054001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ea34-0672-41fc-8afe-a7b95347122b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.218940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:00.234131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e998ea8-1add-44fc-8de4-06d11aa4b2cb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.246591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.247510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.250078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.250489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.251339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.253286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.278659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.279530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 871/1743] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:00.280040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.280739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.281154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.284246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.285744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.292610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.310983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142368b-e0e9-43e2-9223-746944d83df2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.317468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 873/1744] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:00.319143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.325827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.326706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.327095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.327487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.328238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.331910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.347332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb2a3e-fdd8-4dab-a921-8a562227bedc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.383580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.384899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 872/1745] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:00 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:00.388225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.388935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.389049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.389245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] PATH_INFO: `/v3/projects/2de2b73dd6884916a3f68b9c320d8150/users/f237416f86b94d72a77f7073c74abe95/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.415359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074994f-cc3b-41a2-b459-80725e099a01 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.430747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.431868 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.432638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.433279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] PATH_INFO: `/v3/projects/49b4a47492e147d79314753459c82ac9/users/af105cadb93a42c49f333d0d393eacd3/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.475957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b4a47492e147d79314753459c82ac9, user_id=af105cadb93a42c49f333d0d393eacd3, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.480345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.509539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de2b73dd6884916a3f68b9c320d8150, user_id=f237416f86b94d72a77f7073c74abe95, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.516351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f378b07-fb03-42c3-8a5c-80b2d3f7a364 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.527678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 873/1746] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:00 2022] PUT /identity/v3/projects/49b4a47492e147d79314753459c82ac9/users/af105cadb93a42c49f333d0d393eacd3/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:00.529083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:00.581781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 874/1747] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:00 2022] PUT /identity/v3/projects/2de2b73dd6884916a3f68b9c320d8150/users/f237416f86b94d72a77f7073c74abe95/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:00.587531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05754b-3b0b-411a-ba94-bf40b75bf1b1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.590634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05754b-3b0b-411a-ba94-bf40b75bf1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.591551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05754b-3b0b-411a-ba94-bf40b75bf1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.714742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02d06-7eae-4efb-9e07-c37c0e116453 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:00.742942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4c05754b-3b0b-411a-ba94-bf40b75bf1b1 None None] MFA Rules not processed for user `af105cadb93a42c49f333d0d393eacd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:00.745797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4c05754b-3b0b-411a-ba94-bf40b75bf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:00.873598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:00.874363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.874737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.875100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.876564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:00.877900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4a7c7-5c20-40f0-8bcd-3430f9354539 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:00.891587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 874/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:00.896016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:00.896425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:00.896789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:00.938502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] MFA Rules not processed for user `f237416f86b94d72a77f7073c74abe95`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:00.940314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:01.057848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:01.155290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 875/1749] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:01.162765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.169577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 875/1750] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:01.174734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.175588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.177285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.214404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d63ce-d088-4940-8030-7d123c82be21 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.243612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] MFA Rules not processed for user `cd53375218ec492e8e250efe42b3d09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:01.245290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:01.249354 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.250090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.250272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.250539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.251230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.252565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:01.252937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.289640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 876/1751] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:01.292063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.322540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971e8a5-b0d8-4326-8a3b-e10e8883b797 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.349603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.350528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.350954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.351398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.352442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.354677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.361705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 876/1752] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:01.362664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.375218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91e3c-7042-465c-8c5e-4b8c28b6309c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.381021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.381748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.382031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.382308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.382960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.385002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.415837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 877/1753] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:01.418159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.429010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 877/1754] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:01.430430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.589317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28916-0166-4e19-a671-5c9cdab5ca0e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.610234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.611105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.612072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.612427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.614271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.615519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa59d-2f41-4b02-ad58-9d1e091ca328 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.620028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.628360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.629731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.631431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.632003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] PATH_INFO: `/v3/projects/b1da8c50eb2e426ea45fdbe754f944f6/users/eaad8b47c8814885b4e325421502732c/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.690016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1da8c50eb2e426ea45fdbe754f944f6, user_id=eaad8b47c8814885b4e325421502732c, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.702984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.709038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 878/1755] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:01.713342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.726719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fdf3-e44a-4b0e-86ef-8ab039b641c1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:01.741958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 878/1756] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:01 2022] PUT /identity/v3/projects/b1da8c50eb2e426ea45fdbe754f944f6/users/eaad8b47c8814885b4e325421502732c/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:01.748924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:01.824289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:01.824884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.825164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.825499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.826244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:01.837525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f21d39-a9eb-454b-812c-a67bace59322 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:01.915925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 879/1757] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:01.917217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:01.917217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:01.917495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:01.992897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:02.017608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94c08-4fb9-4c65-9e7c-00e38a30b2e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.020272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] MFA Rules not processed for user `eaad8b47c8814885b4e325421502732c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:02.024870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:02.034789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.035813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.036243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.036654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.037587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.041302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.071441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 879/1758] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:02.074590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.110589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0047-68d9-4da3-a0e5-9d8be88d730a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.125988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.126819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.127260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.127620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.128548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.135045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.178291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 880/1759] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:02.179884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.203704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b582e-72ef-45e1-9784-f939a7e699e0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.223596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.224446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.226669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.227094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.228018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.248045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.275034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 881/1760] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:02.278067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.329338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 880/1761] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:02.331069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.346949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ef003-d52d-4261-8810-7f543f235123 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.366165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.368370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.372892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.375965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] PATH_INFO: `/v3/projects/895b5116340a48258152d4e213277b4d/users/0af73a8be76842b8b81277cce2cbb34d/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.378981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7acd8-8c48-4366-ae8d-6afaf06fd41b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.384490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:02.394139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.396945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.397379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.397764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] PATH_INFO: `/v3/projects/b926e12a25c54c6183196eb72a1c62f0/users/2cca019b3f684abb90d93e7b3518d33a/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.421159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895b5116340a48258152d4e213277b4d, user_id=0af73a8be76842b8b81277cce2cbb34d, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.428217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.439352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b926e12a25c54c6183196eb72a1c62f0, user_id=2cca019b3f684abb90d93e7b3518d33a, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.442944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.472499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 882/1762] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:02 2022] PUT /identity/v3/projects/895b5116340a48258152d4e213277b4d/users/0af73a8be76842b8b81277cce2cbb34d/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:02.477349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 881/1763] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:02 2022] PUT /identity/v3/projects/b926e12a25c54c6183196eb72a1c62f0/users/2cca019b3f684abb90d93e7b3518d33a/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:02.479149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.480336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:02.602504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e38bb9-08f5-4a83-afa3-41e7d38da680 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.617873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:02.618869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.620297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.621942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.623627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:02.629047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8875-afb5-4c3f-89a0-f974b6699f9c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:02.681278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 882/1764] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:02 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:02.682963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:02.683598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:02.699777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:02.750546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c685-0fc1-4b1e-9880-d5257ca8b9b5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:02.771016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] MFA Rules not processed for user `2cca019b3f684abb90d93e7b3518d33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:02.774464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:02.866347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:02.898593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 883/1765] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:02.899730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.025909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64d750-eee4-4b8b-ac06-7f0a64cef7b5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.038071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.038801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.039256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.039671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.040619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:03.043984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:03.075175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.076272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.076820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.077208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.090234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:03.091416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 884/1766] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:02 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:03.092560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.105514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f38a7-8f72-45f8-9731-91307d30ede3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:03.107237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913782-f051-46c5-ac72-b3dc68e63282 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.117221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.118017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.118293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.118569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.119652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:03.123804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:03.135451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 883/1767] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 656 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:03.138143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.138941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.139482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.172495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 885/1768] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:03.172957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.296366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:03.300312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:03.426769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682304-9c4e-4da7-8dff-ad60d793096c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.437873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.456434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.456899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.457381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.458687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:03.472823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:03.576181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 886/1769] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:03.577026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.630027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd029e-e10b-46c4-bd1b-ac661b42d100 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.650400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.651571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.651571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.651734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] PATH_INFO: `/v3/projects/895b5116340a48258152d4e213277b4d/users/0af73a8be76842b8b81277cce2cbb34d/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.662220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895b5116340a48258152d4e213277b4d, user_id=0af73a8be76842b8b81277cce2cbb34d, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:03.665041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:03.703605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 887/1770] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:03 2022] PUT /identity/v3/projects/895b5116340a48258152d4e213277b4d/users/0af73a8be76842b8b81277cce2cbb34d/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:03.704546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.725193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:03.741803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 884/1771] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:34:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:03.742827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:03.785459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcc0e4-b7f2-45e2-a3ef-fb38c8762919 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.876488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:03.939278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1598f-6e5f-42d9-bc9b-5bc81d7ca208 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:03.983120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.992550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.993945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.994190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:03.994921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:03.995223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:03.995526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] PATH_INFO: `/v3/projects/ed0f06c7b8e54023ad3138b5807a3370/users/0f87198981ea41e8be361632b98282ed/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.996307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:03.998482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:04.049272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:04.072337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0f06c7b8e54023ad3138b5807a3370, user_id=0f87198981ea41e8be361632b98282ed, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:04.090125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ecaa1-582f-4dc3-b03c-c336e463add6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:04.182734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 885/1772] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:03 2022] PUT /identity/v3/projects/ed0f06c7b8e54023ad3138b5807a3370/users/0f87198981ea41e8be361632b98282ed/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:04.193407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1450c2-76c3-416b-815c-493188300846 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:04.196234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1450c2-76c3-416b-815c-493188300846 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:04.196666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1450c2-76c3-416b-815c-493188300846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:04.213024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 888/1773] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:03 2022] POST /identity/v3/users => generated 300 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:04.218854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:04.230318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:04.359308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1f1450c2-76c3-416b-815c-493188300846 None None] MFA Rules not processed for user `0af73a8be76842b8b81277cce2cbb34d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:04.361708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f1450c2-76c3-416b-815c-493188300846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:04.636650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 886/1774] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:04.638395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1450c2-76c3-416b-815c-493188300846 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:04.753487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1450c2-76c3-416b-815c-493188300846 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:04.773788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:04.776019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:04.776365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:04.778643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:04.779420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:04.786187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcc335-1284-44c1-a12a-8af41b552911 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:04.789156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:04.825377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 887/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:04.825377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:04.849872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:04.879246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c9c7-2437-4c5f-9382-e41618e3c291 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:04.902897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:04.906895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:04.912104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:04.912889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:04.917029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:04.926455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:04.966223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 888/1776] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:04.968445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:04.971398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:05.047578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:05.048681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:05.049087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:05.049515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:05.146156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e070f1-a1e1-465b-a5bb-0a614fd2e4db admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:05.173222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:05.174723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:05.179891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:05.180592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:05.246419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:05.249377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:05.311944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:05.315529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:05.318940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 889/1777] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:05.320554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:05.325316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:05.355482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 889/1778] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:34:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:34:05.360862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:05.389192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ff429-010f-470d-b0e6-6f3e8e057cb7 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:05.447952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:05.451672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:05.457241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:05.465084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] PATH_INFO: `/v3/projects/ed0f06c7b8e54023ad3138b5807a3370/users/0f87198981ea41e8be361632b98282ed/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:05.478963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3135-1c07-455b-b9d8-090a2436580a service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:05.480591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0f06c7b8e54023ad3138b5807a3370, user_id=0f87198981ea41e8be361632b98282ed, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:05.502153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:05.505041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:05.507048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17079-cc60-4a9f-b8f9-f1dfd2a94b2b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:05.514916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:05.515868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] PATH_INFO: `/v3/projects/2cbb2fe267f342ef910c120be38bd432/users/74ff8850b86b4edcb942106bb3b33b9a/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:05.541001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 890/1779] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:05 2022] PUT /identity/v3/projects/ed0f06c7b8e54023ad3138b5807a3370/users/0f87198981ea41e8be361632b98282ed/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:05.568183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:05.569484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:05.570280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:05.590086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb2fe267f342ef910c120be38bd432, user_id=74ff8850b86b4edcb942106bb3b33b9a, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:05.602258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:05.672170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 890/1780] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:05 2022] PUT /identity/v3/projects/2cbb2fe267f342ef910c120be38bd432/users/74ff8850b86b4edcb942106bb3b33b9a/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:05.682380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:05.804039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] MFA Rules not processed for user `0f87198981ea41e8be361632b98282ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:05.812716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:05.968273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461487aa-c834-4b6d-a642-8ea074ab2f8d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:06.000094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:06.001136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:06.001588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:06.011888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:06.019908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:06.028059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:06.113773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 891/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:06.125765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:06.142417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:06.238345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a90f2-9ce8-4c8f-a3dd-e91481e5d2b0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:06.277640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:06.294175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:06.302383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 891/1782] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 730 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:06.302383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:06.302859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:06.302859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] PATH_INFO: `/v3/users/bd33a0986d834b788102badb287a0b66` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:06.303857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd33a0986d834b788102badb287a0b66)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:06.315891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:06.362775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471757b7-56d0-4ecd-8c0e-288deb4d0a4f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:06.397720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:06.405581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:06.411005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:06.411992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] PATH_INFO: `/v3/projects/2cbb2fe267f342ef910c120be38bd432/users/74ff8850b86b4edcb942106bb3b33b9a/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:06.418529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb2fe267f342ef910c120be38bd432, user_id=74ff8850b86b4edcb942106bb3b33b9a, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:06.429871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:06.480859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 892/1783] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:06 2022] PUT /identity/v3/projects/2cbb2fe267f342ef910c120be38bd432/users/74ff8850b86b4edcb942106bb3b33b9a/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:06.493968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:06.569894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd33a0986d834b788102badb287a0b66'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:06.571859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd33a0986d834b788102badb287a0b66'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:06.576448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd33a0986d834b788102badb287a0b66'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:06.629720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd33a0986d834b788102badb287a0b66'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:06.739434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd33a0986d834b788102badb287a0b66'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:06.816764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 892/1784] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:06 2022] DELETE /identity/v3/users/bd33a0986d834b788102badb287a0b66 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:06.817845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:06.831748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:06.956262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:07.024237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8fe63-8485-422d-99ab-4c2a647d7190 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:07.135387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:07.180637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be831-bace-4d77-b66f-be5172aa7581 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:07.204854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:07.206407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:07.208120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:07.208865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:07.216856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:07.405343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:07.407474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:07.408244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:07.410181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] PATH_INFO: `/v3/users/af105cadb93a42c49f333d0d393eacd3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:07.413913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] RBAC: Authorizing `identity:delete_user(user_id=af105cadb93a42c49f333d0d393eacd3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:07.428327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:07.509115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:07.512767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f5d9c-b910-4a3f-b3e0-6c0022a85850 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:07.551502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 893/1785] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:07.557003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93094d4-78f7-4fd9-9f98-a91b95504823 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:07.558205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93094d4-78f7-4fd9-9f98-a91b95504823 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:07.559759 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93094d4-78f7-4fd9-9f98-a91b95504823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:07.687767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af105cadb93a42c49f333d0d393eacd3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:07.690720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af105cadb93a42c49f333d0d393eacd3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:07.693507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af105cadb93a42c49f333d0d393eacd3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:07.710536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d93094d4-78f7-4fd9-9f98-a91b95504823 None None] MFA Rules not processed for user `74ff8850b86b4edcb942106bb3b33b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:07.710536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d93094d4-78f7-4fd9-9f98-a91b95504823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:07.730687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af105cadb93a42c49f333d0d393eacd3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:07.768911 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be9ea28-72e0-4a6c-af70-6021931130db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af105cadb93a42c49f333d0d393eacd3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:07.822561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 893/1786] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:06 2022] DELETE /identity/v3/users/af105cadb93a42c49f333d0d393eacd3 => generated 0 bytes in 1329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:07.824313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:07.829208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:07.832298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:07.924032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:07.941617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:07.974386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 894/1787] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:07.975860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c691-198c-4102-b628-61d556380f3e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:07.976147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c691-198c-4102-b628-61d556380f3e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:07.976425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c691-198c-4102-b628-61d556380f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.043854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4e59c691-198c-4102-b628-61d556380f3e None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:08.052098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e59c691-198c-4102-b628-61d556380f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.242496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 895/1788] 10.222.0.44 () {58 vars in 1015 bytes} [Sun Aug 7 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:08.244060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:08.244432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:08.244798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.285820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:08.287010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.294330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 894/1789] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:08.296057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:08.298707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.315165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 896/1790] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:08.315165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:08.326648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.352705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:08.382065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:08.497438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408456-3231-4de3-b628-5dd2103edd8c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:08.509955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:08.513344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:08.515923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:08.517198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.564193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4eccf-7a9d-426b-a976-962828cab7bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:08.593997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:08.596696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:08.597172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:08.597674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.608586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.740854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:08.743373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:08.780984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 897/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:08.783167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:08.787123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:08.816478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d22ee-d416-4c6a-a825-5dd29498fbe5 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:08.828319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:08.829491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:08.830955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:08.834051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.846954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:08.854188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:08.886799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:08.890106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:08.911825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 895/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:08.912998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:08.943997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 898/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:08.945125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:08.961476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d39cf-d048-4e64-8e71-c3ea52486cf5 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:08.973807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:08.973807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:08.973807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:08.974204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:08.982400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab0243-a4f5-400f-bb00-2842867b5a5c service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:09.007475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:09.008238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:09.008630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:09.008990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:09.017783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:09.027863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:09.042880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:09.046785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:09.071564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 896/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:09.098897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 899/1795] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:10.564804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:10.594031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f91b71-e01f-400b-ad67-272fbfd5f79e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:10.602742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:10.605073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:10.606108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:10.607115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:10.611322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:10.854107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:10.856218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:10.922495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 897/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:13.004906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:13.010813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:13.069645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57a51a-29c6-46cd-85e5-d89815af5be3 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:13.088353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:13.092551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:13.092957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:13.098516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] PATH_INFO: `/v3/projects/49b4a47492e147d79314753459c82ac9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:13.106108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b4a47492e147d79314753459c82ac9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:13.113711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:13.335143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b4a47492e147d79314753459c82ac9', 'request_id': 'req-0d1c9fef-20f2-475d-a42c-9865602c6dd3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:13.360242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b4a47492e147d79314753459c82ac9', 'request_id': 'req-0d1c9fef-20f2-475d-a42c-9865602c6dd3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:13.386258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b4a47492e147d79314753459c82ac9', 'request_id': 'req-0d1c9fef-20f2-475d-a42c-9865602c6dd3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:13.432201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] The token cache is being invalidate because project 49b4a47492e147d79314753459c82ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:13.452778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:13.454022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:13.462469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 900/1797] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:13 2022] DELETE /identity/v3/projects/49b4a47492e147d79314753459c82ac9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:13.463529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:13.486563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279b8a-deb7-49a8-89a2-bcbbd8a29702 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:13.753066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:13.755955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:13.756757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:13.757542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] PATH_INFO: `/v3/users/0af73a8be76842b8b81277cce2cbb34d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:13.762334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af73a8be76842b8b81277cce2cbb34d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:13.775153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:13.784181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:13.930051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:13.937017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:13.971053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9fef-20f2-475d-a42c-9865602c6dd3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:13.982430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:13.985662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:13.987599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:13.988570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] PATH_INFO: `/v3/projects/d4d8c2d6a68e4f1995bfc7de4608334c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:13.991061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d8c2d6a68e4f1995bfc7de4608334c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:13.997828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:14.163920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:14.280298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d8c2d6a68e4f1995bfc7de4608334c', 'request_id': 'req-9ff8ebe4-1854-4719-a124-770e3d3cff2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.302742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af73a8be76842b8b81277cce2cbb34d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.304160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d8c2d6a68e4f1995bfc7de4608334c', 'request_id': 'req-9ff8ebe4-1854-4719-a124-770e3d3cff2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.308650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af73a8be76842b8b81277cce2cbb34d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.311681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af73a8be76842b8b81277cce2cbb34d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.345403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d8c2d6a68e4f1995bfc7de4608334c', 'request_id': 'req-9ff8ebe4-1854-4719-a124-770e3d3cff2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.374528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] The token cache is being invalidate because project d4d8c2d6a68e4f1995bfc7de4608334c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:14.375740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.377255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.381602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 901/1798] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:13 2022] DELETE /identity/v3/projects/d4d8c2d6a68e4f1995bfc7de4608334c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:14.385931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af73a8be76842b8b81277cce2cbb34d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.386883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:14.392408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:14.440547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff50e643-6cfd-4e73-8713-4f2f69ac952e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af73a8be76842b8b81277cce2cbb34d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:14.490871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 898/1799] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:13 2022] DELETE /identity/v3/users/0af73a8be76842b8b81277cce2cbb34d => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:14.681061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ebe4-1854-4719-a124-770e3d3cff2d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:15.041259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:15.042422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:15.044167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:15.045318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] PATH_INFO: `/v3/users/32217acff7db47c3b313b0aa0a2cf4aa` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:15.049365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32217acff7db47c3b313b0aa0a2cf4aa)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:15.068663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:15.224735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eb4b-9935-4a47-bd28-6eaa1103aa45 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:15.225416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eb4b-9935-4a47-bd28-6eaa1103aa45 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:15.225989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eb4b-9935-4a47-bd28-6eaa1103aa45 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:15.230922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 899/1800] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:34:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:34:15.277963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32217acff7db47c3b313b0aa0a2cf4aa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:15.278903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca4ae-ca75-4877-a822-a69f7329bcb4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:15.279053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32217acff7db47c3b313b0aa0a2cf4aa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:15.279470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32217acff7db47c3b313b0aa0a2cf4aa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:15.280092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca4ae-ca75-4877-a822-a69f7329bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:15.280535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca4ae-ca75-4877-a822-a69f7329bcb4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:15.283277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 900/1801] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:34:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:34:15.324569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32217acff7db47c3b313b0aa0a2cf4aa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:15.327040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:15.348305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:15.348496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:15.348647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:15.391230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:15.391607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c302965c-df88-4e4b-bdda-3048446a2a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32217acff7db47c3b313b0aa0a2cf4aa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:15.393925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:15.449028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 902/1802] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:14 2022] DELETE /identity/v3/users/32217acff7db47c3b313b0aa0a2cf4aa => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:15.454412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:15.454817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:15.455057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:15.553897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:15.563365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:15.631352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 901/1803] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:15.820859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 903/1804] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:16.346806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:16.349895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:16.391845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b367a7-b383-45cb-9e56-e57718663d88 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:16.406795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:16.408487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:16.408487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:16.408487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:16.442218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:16.448863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:16.491415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 902/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:16.792612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:16.810913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746528-533a-41d4-8a53-59b69773ae29 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:16.828498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:16.834478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:16.835654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:16.837053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:16.904518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:16.910900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c6940-ea53-41d8-91ff-ea7c284fa95d service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:17.003564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 904/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:17.009145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:17.011151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:17.211872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:17.217694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42230148-7ff0-4745-84b8-da4d4a72d1d6 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:17.234386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:17.235281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:17.235526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:17.236037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] PATH_INFO: `/v3/projects/895b5116340a48258152d4e213277b4d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:17.237940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895b5116340a48258152d4e213277b4d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:17.240870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:17.419880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895b5116340a48258152d4e213277b4d', 'request_id': 'req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:17.438099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895b5116340a48258152d4e213277b4d', 'request_id': 'req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:17.459569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895b5116340a48258152d4e213277b4d', 'request_id': 'req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:17.479278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] The token cache is being invalidate because project 895b5116340a48258152d4e213277b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:17.479859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:17.480777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bdb890ab-9b8e-425f-8d4c-f1b5eb734872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:17.486393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 903/1807] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:17 2022] DELETE /identity/v3/projects/895b5116340a48258152d4e213277b4d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:17.488762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:17.489107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:17.489390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:17.536448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:17.545111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:17.780345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:17.780899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:17.781375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:17.790117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 905/1808] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:17.805577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:17.807109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:17.823158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 904/1809] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:17.824838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:17.838433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c9c79-c929-4cb4-8b6d-104af8eedd5d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:17.843867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:17.845163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:17.845771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:17.846192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:17.847392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:17.847847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:17.863228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:17.885060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 906/1810] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:17.890333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:17.900651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7258c-0a7c-44b4-96f9-cbcb6e37f4ba None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:17.918304 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:17.920427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:17.921005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:17.921443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:17.935882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:17.941352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:18.025691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 905/1811] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:17 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:18.028425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:18.061238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4e20-e24a-4baa-a9a6-23edf856025f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:18.130587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:18.177413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:18.178365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.178976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.180058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.181348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:18.184712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:18.223619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 907/1812] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:18 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:18.224918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:18.244942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86745828-5d80-4fb2-8f75-27d4a65dbee0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:18.261042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:18.264204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.265924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.267042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.269630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:18.275280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:18.307867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 906/1813] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:18.312988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:18.342968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17484a-2376-4daf-89c7-af8efe6f9773 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:18.354907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:18.356707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.357935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.358921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.360663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:18.365119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865cc2-211f-4872-9c3e-e9f7ccd39971 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:18.412103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 908/1814] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:18.413438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:18.468317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cce1fd-0be9-4ace-8d73-83a0ab796ddb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:18.476485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:18.478238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.478962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.479478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] PATH_INFO: `/v3/projects/a696e9337b9849eeb2cf43ab4e6fd1a6/users/241de1910c7d4be99e36c08bff7ed233/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.509190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a696e9337b9849eeb2cf43ab4e6fd1a6, user_id=241de1910c7d4be99e36c08bff7ed233, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:18.514092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:18.566081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 907/1815] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:18 2022] PUT /identity/v3/projects/a696e9337b9849eeb2cf43ab4e6fd1a6/users/241de1910c7d4be99e36c08bff7ed233/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:18.567823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.568113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.568758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.573861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:18.581361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:18.709939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] MFA Rules not processed for user `241de1910c7d4be99e36c08bff7ed233`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:18.712738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:18.913331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cafc1d-608d-405f-bff1-79b8e6f8276b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:18.930198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:18.933622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:18.936100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:18.937211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:18.951592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:19.047335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 909/1816] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:19.049618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:19.104306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:19.214357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:19.219217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:19.264302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 908/1817] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:34:19.330752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1f81d-101a-4cc5-b516-1ed7743523f5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:19.340885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:19.341926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:19.342425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:19.342914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:19.346254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:19.356599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:19.496214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 910/1818] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:19 2022] POST /identity/v3/projects => generated 365 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:19.497962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:19.529523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670080d3-2a5c-49c9-87ed-9cd2570d6bce service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:19.837078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:19.839436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:19.851915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:19.853021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:19.853533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:19.854019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:19.856949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:19.863024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:19.941190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 909/1819] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:19 2022] POST /identity/v3/users => generated 289 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:19.942509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:19.966131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:20.031690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745dbad-952e-4597-b24f-f26d391c6cf3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.062804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.068704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.070792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.071711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.074843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.079507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.114874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece177a6-0f24-4306-a5e8-865f0858a4e2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.129642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 910/1820] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:20.134802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:20.146028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.149590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.152233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.154435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] PATH_INFO: `/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.158906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=73cbe1fbd7db40a7a5c8e46fee50ca88)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.175737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.186903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4958-0cd2-4c39-b897-1ecb219b5c93 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.204319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.207445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.208553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.222973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] PATH_INFO: `/v3/projects/b12a2742a7fa441faff71194dda1857e/users/cbba50a7a0b6432ea901b0a59a88f4ac/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.322864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73cbe1fbd7db40a7a5c8e46fee50ca88', 'request_id': 'req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:20.332083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12a2742a7fa441faff71194dda1857e, user_id=cbba50a7a0b6432ea901b0a59a88f4ac, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.339803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.345919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73cbe1fbd7db40a7a5c8e46fee50ca88', 'request_id': 'req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:20.365817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73cbe1fbd7db40a7a5c8e46fee50ca88', 'request_id': 'req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:20.375266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 911/1821] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:20 2022] PUT /identity/v3/projects/b12a2742a7fa441faff71194dda1857e/users/cbba50a7a0b6432ea901b0a59a88f4ac/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:20.379316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:20.445616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] The token cache is being invalidate because project 73cbe1fbd7db40a7a5c8e46fee50ca88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:20.445969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:20.446689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f23fabe3-bcb4-498f-a1c5-6029ce9b5cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:20.455399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 911/1822] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:19 2022] DELETE /identity/v3/projects/73cbe1fbd7db40a7a5c8e46fee50ca88 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:20.466535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995c23-0894-4320-b109-932f66e78280 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.467045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995c23-0894-4320-b109-932f66e78280 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.469122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995c23-0894-4320-b109-932f66e78280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.528835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed5e6-671f-4168-8b45-d864c37bb5e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.543746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.545272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4e995c23-0894-4320-b109-932f66e78280 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:20.545622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.546041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.547107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.548676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.554910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.555451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e995c23-0894-4320-b109-932f66e78280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:20.585086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 912/1823] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:20.598515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.598959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 912/1824] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:20.600982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.601959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.605871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:20.616736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:20.663809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb247-cafc-409e-8ed1-79a5c7f0241b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.672245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:20.675421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:20.681767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.682473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.682753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.683052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] PATH_INFO: `/v3/projects/b12a2742a7fa441faff71194dda1857e/users/cbba50a7a0b6432ea901b0a59a88f4ac/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.689680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12a2742a7fa441faff71194dda1857e, user_id=cbba50a7a0b6432ea901b0a59a88f4ac, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.699821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 913/1825] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:20.702062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:20.705076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.714907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:20.759486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b86b-d2c0-4b16-8ffb-8750b315274d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.783162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 913/1826] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:20 2022] PUT /identity/v3/projects/b12a2742a7fa441faff71194dda1857e/users/cbba50a7a0b6432ea901b0a59a88f4ac/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:20.785144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:20.862035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:20.936531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.938028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.938653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.939320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] PATH_INFO: `/v3/users/eaad8b47c8814885b4e325421502732c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.942494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaad8b47c8814885b4e325421502732c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.947345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:20.976471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6174dd-58f3-45ca-8593-4d43613c7968 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:20.987859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:20.989144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:20.990063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:20.990954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:20.992501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:20.993107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:20.996550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773306b-750d-434b-8386-3cb61d713a4c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:21.038867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 914/1827] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:21.051507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac94c-f375-498b-8e63-cd123c765688 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.051842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac94c-f375-498b-8e63-cd123c765688 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.054022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac94c-f375-498b-8e63-cd123c765688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.121977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a03ac94c-f375-498b-8e63-cd123c765688 None None] MFA Rules not processed for user `cbba50a7a0b6432ea901b0a59a88f4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:21.123487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a03ac94c-f375-498b-8e63-cd123c765688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:21.162828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaad8b47c8814885b4e325421502732c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:21.164585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaad8b47c8814885b4e325421502732c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:21.166383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaad8b47c8814885b4e325421502732c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:21.180000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:21.195688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaad8b47c8814885b4e325421502732c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:21.261805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaad8b47c8814885b4e325421502732c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:21.316246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 914/1828] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:20 2022] DELETE /identity/v3/users/eaad8b47c8814885b4e325421502732c => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:21.317321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:21.321468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:21.341382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 915/1829] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:21.342861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.343220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.343537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.394029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:21.397183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:21.529447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fcb70-c935-4d7f-a378-10d6ab17dcd8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:21.544180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:21.545378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.546181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.546650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.548118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:21.552270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:21.558405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 916/1830] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:21.565610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:21.572311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:21.630502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 915/1831] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:21 2022] POST /identity/v3/projects => generated 377 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:21.630502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:21.634039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:21.679517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:21.713663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f48e-6227-47a4-9459-525496d5992b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:21.758472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442c70-4103-49da-93db-8d7b1a1542d8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:21.769955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:21.770651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.770933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.771947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.806085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:21.807395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.807953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.808508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.858724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:21.860803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:21.875185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 916/1832] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:21.880521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:21.889482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:21.895909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb510-f865-4899-8fbe-90111bfc7e85 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:21.907139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:21.908795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.909477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.909922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.911456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:21.914201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:21.925929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:21.928212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:21.945745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 917/1833] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:21 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:21.947698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 917/1834] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:21.952936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:21.974689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070e17-ed9e-4af1-a5aa-756ffa31e3ec admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:21.984711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:21.985895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:21.986479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:21.987398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:21.988938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:21.991899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.011490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 918/1835] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:22.016137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.035424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11eb0-b417-405e-8393-6b8d0c9385db service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.046413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.047513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.047993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.048677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.049522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.053027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.073203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.077128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 918/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:34:22.078853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.088774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bde6a-8d84-4709-bc4b-22d25d4c9eb2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.092578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4590f4a-f2f0-462a-9335-843f879c3877 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.094189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.095132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.095679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.095972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.098840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:22.099238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.100660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.101099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.101493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] PATH_INFO: `/v3/projects/e4df5769cf8f40418ebcfd25569180f3/users/e4c20761237140c4ae0732a1a2c6992b/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.125013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4df5769cf8f40418ebcfd25569180f3, user_id=e4c20761237140c4ae0732a1a2c6992b, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.125916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c5903-3e73-4702-a153-142aeffe9115 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.148516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 919/1837] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:22 2022] PUT /identity/v3/projects/e4df5769cf8f40418ebcfd25569180f3/users/e4c20761237140c4ae0732a1a2c6992b/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:22.172741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.173083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.173407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.212464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.214847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.220897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] MFA Rules not processed for user `e4c20761237140c4ae0732a1a2c6992b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:22.224165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:22.234562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 919/1838] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:22.320643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:22.339902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 920/1839] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:22.342008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.387565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a6df-9351-448e-8e51-e77d6563a5b1 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.533583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.534747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.535104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.535526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.536573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.539743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.567753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.571484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:22.587275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 920/1840] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:22 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:22.601826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.602437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1c213-bf00-411d-949b-608a862ea67b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.694635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.695355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.695706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.696000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] PATH_INFO: `/v3/projects/b1da8c50eb2e426ea45fdbe754f944f6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.697160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1da8c50eb2e426ea45fdbe754f944f6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.699455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.705814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68563cf1-5276-4af6-952d-adbf53ed950d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.723511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.725105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.726065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.726065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.726653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.728762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.738091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:22.767712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 921/1841] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:22 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:22.771609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.781929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1da8c50eb2e426ea45fdbe754f944f6', 'request_id': 'req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:22.787543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00633501-86f5-4c1f-a2b6-d4d63fd32b08 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:22.796240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1da8c50eb2e426ea45fdbe754f944f6', 'request_id': 'req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:22.816560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1da8c50eb2e426ea45fdbe754f944f6', 'request_id': 'req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:22.835115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] The token cache is being invalidate because project b1da8c50eb2e426ea45fdbe754f944f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:22.835529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:22.836629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:22.838810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 921/1842] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:22 2022] DELETE /identity/v3/projects/b1da8c50eb2e426ea45fdbe754f944f6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:22.842944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.844713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:22.891256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:22.892285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:22.892761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:22.893227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:22.894480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:22.898373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:22.919059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 922/1843] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:22.926623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:22.932675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:22.979377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143886-977d-4d42-9718-0b300031db02 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:23.014035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:23.017320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.019450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.019884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] PATH_INFO: `/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45/users/6e3557a675be4b0e8f587699aea04e00/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.032026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7935b2-4ef4-4de9-9baa-31a5efbcd1c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:23.038788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:23.039828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.040651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.041162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] PATH_INFO: `/v3/users/0f87198981ea41e8be361632b98282ed` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.043763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f87198981ea41e8be361632b98282ed)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:23.045941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a0002a33c34a5dbb73f9c4e035be45, user_id=6e3557a675be4b0e8f587699aea04e00, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:23.046794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:23.051161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:23.075254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 923/1844] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:22 2022] PUT /identity/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45/users/6e3557a675be4b0e8f587699aea04e00/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:23.078785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:23.104199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:23.147553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f87198981ea41e8be361632b98282ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.147553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f87198981ea41e8be361632b98282ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.147553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f87198981ea41e8be361632b98282ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.168731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f87198981ea41e8be361632b98282ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.178038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f87198981ea41e8be361632b98282ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.207344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 922/1845] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:22 2022] DELETE /identity/v3/users/0f87198981ea41e8be361632b98282ed => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:23.271104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a77671-ec6d-4d27-8092-33f2a3a76b9d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:23.296113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:23.300116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:23.407019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:23.408371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.409257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.410128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.412367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:23.416616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:23.444923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 924/1846] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:23.449498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:23.461773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:23.488604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:23.505406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f925cc0-c800-4a4e-88bc-24f263f4d886 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:23.508689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6611d-4646-4e5c-9200-2c6892d0552f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:23.527138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:23.533072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.534098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.534741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] PATH_INFO: `/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45/users/6e3557a675be4b0e8f587699aea04e00/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.557191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:23.558097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a0002a33c34a5dbb73f9c4e035be45, user_id=6e3557a675be4b0e8f587699aea04e00, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:23.558548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.559099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.560251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] PATH_INFO: `/v3/users/f237416f86b94d72a77f7073c74abe95` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.562948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f237416f86b94d72a77f7073c74abe95)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:23.567664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee986dd-195a-4d8a-9c0f-98ae7c412687 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:23.570390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:23.607039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 925/1847] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:23 2022] PUT /identity/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45/users/6e3557a675be4b0e8f587699aea04e00/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:23.618677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.619611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.620347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.699734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] MFA Rules not processed for user `6e3557a675be4b0e8f587699aea04e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:23.702724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:23.751275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f237416f86b94d72a77f7073c74abe95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.752489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f237416f86b94d72a77f7073c74abe95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.753631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f237416f86b94d72a77f7073c74abe95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.780464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f237416f86b94d72a77f7073c74abe95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.795053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e0d8502-a8f4-469d-a5fb-dcd2266bdd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f237416f86b94d72a77f7073c74abe95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:23.827217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 923/1848] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:23 2022] DELETE /identity/v3/users/f237416f86b94d72a77f7073c74abe95 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:23.834016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:23.834403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:23.835713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:23.865287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:23.867136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:23.871756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 926/1849] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:23.904509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:23.906232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:23.910191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:23.989817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 924/1850] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:24.002546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:24.006046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:24.038075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c6b78-8c1e-4cf5-b12b-b653555615ce None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:24.122608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30f78-c765-4bb7-8070-2d12720c5ef7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:24.130798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:24.132664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.139378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.139378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.153580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:24.155258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:24.171082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 925/1851] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:24.172468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:24.174263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:24.190760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:24.191237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0ff8-16f2-4bb6-a2c2-c7e223701266 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:24.191680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.192058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.192598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.197145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:24.198378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:24.199297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.199764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.200248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] PATH_INFO: `/v3/projects/ed0f06c7b8e54023ad3138b5807a3370` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.202344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0f06c7b8e54023ad3138b5807a3370)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:24.205060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:24.298537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0f06c7b8e54023ad3138b5807a3370', 'request_id': 'req-1284c445-d112-44da-aa8f-c1dcca6e42c6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:24.315852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0f06c7b8e54023ad3138b5807a3370', 'request_id': 'req-1284c445-d112-44da-aa8f-c1dcca6e42c6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:24.339542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:24.345877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0f06c7b8e54023ad3138b5807a3370', 'request_id': 'req-1284c445-d112-44da-aa8f-c1dcca6e42c6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:24.373706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:24.375402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bd270-f526-4e33-bcfb-e1dcf2d4e37f service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:24.378524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] The token cache is being invalidate because project ed0f06c7b8e54023ad3138b5807a3370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:24.378818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:24.379607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1284c445-d112-44da-aa8f-c1dcca6e42c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:24.382565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 926/1852] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:24 2022] DELETE /identity/v3/projects/ed0f06c7b8e54023ad3138b5807a3370 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:24.388357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.388638 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.388913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.391617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 927/1853] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:24.419180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:24.420803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:24.534152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:24.579561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 927/1854] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:24.595958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.596249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.596571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.639607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:24.641812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:24.656926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 928/1855] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:24.664513 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:24.683997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2ee7d-fdb5-4165-b160-03f362f78ff3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:24.695050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:24.696200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.696524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.696972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.698050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:24.699056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:24.703770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:24.753529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 928/1856] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:24.755187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:24.787420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b335b-6a5e-472e-8efc-ca9aa4a58445 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:24.794880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:24.795734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:24.796117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:24.796395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:24.797066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:24.799040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:24.864166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 929/1857] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:24 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:24.867873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:24.889662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e68-2ab5-467f-b324-56b7ec217595 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.084738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.085461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.085746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.086160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.086868 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.089303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.132691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 929/1858] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:24 2022] POST /identity/v3/users => generated 284 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:25.138335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.159462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7c25e-ce7f-45fe-b2f4-005dbd2d2ecf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.172673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.175241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.177320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.177694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.178538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.182212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.217684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 930/1859] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:25.219979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.232763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.236379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.245435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88dee6-c901-43d9-bdcc-a16210823fe4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.270699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.273648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.274448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.275597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.277939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.285068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.285886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc1f6e-1f91-40cf-bcec-5f47bb27b43e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.324556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.326378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.326978 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.327905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] PATH_INFO: `/v3/projects/2de2b73dd6884916a3f68b9c320d8150` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.332911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de2b73dd6884916a3f68b9c320d8150)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.339017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 930/1860] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:25.341083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.345338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.371059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213472-799a-4a0b-8b54-58938e3ccd35 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.378005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.379358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.379824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.380423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] PATH_INFO: `/v3/projects/688bdfc69a36410b976747b2a3e25766/users/3ef2ddbba9974f89a64f26b13fc7475f/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.402784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=688bdfc69a36410b976747b2a3e25766, user_id=3ef2ddbba9974f89a64f26b13fc7475f, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.406219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b37d7-c2c3-4d72-b3bd-3b93e9c0d70f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.433229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 931/1861] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:25 2022] PUT /identity/v3/projects/688bdfc69a36410b976747b2a3e25766/users/3ef2ddbba9974f89a64f26b13fc7475f/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:25.456098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.457712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.458230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.480677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de2b73dd6884916a3f68b9c320d8150', 'request_id': 'req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.490503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de2b73dd6884916a3f68b9c320d8150', 'request_id': 'req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.506883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de2b73dd6884916a3f68b9c320d8150', 'request_id': 'req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.530797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] The token cache is being invalidate because project 2de2b73dd6884916a3f68b9c320d8150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:25.531250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.532142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.534280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] MFA Rules not processed for user `3ef2ddbba9974f89a64f26b13fc7475f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:25.535790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 931/1862] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:25 2022] DELETE /identity/v3/projects/2de2b73dd6884916a3f68b9c320d8150 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:25.536278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.536744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.540391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.664448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 932/1863] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:25.666299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.668355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c156f6-51c7-462c-b2d8-5a6f16ecbcca admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.670309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.677506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.678205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.678482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.679051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] PATH_INFO: `/v3/users/7ca847eacc0040b1af9a8c198d7b6daa` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.680740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca847eacc0040b1af9a8c198d7b6daa)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.682884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.687913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142574c9-a519-44d3-bd8e-dda694d53ac5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.693635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.694297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.694567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.694819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] PATH_INFO: `/v3/users/2cca019b3f684abb90d93e7b3518d33a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.696205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cca019b3f684abb90d93e7b3518d33a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.698319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:25.721410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:25.731381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:25.764768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca847eacc0040b1af9a8c198d7b6daa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.765914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca847eacc0040b1af9a8c198d7b6daa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.767606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca847eacc0040b1af9a8c198d7b6daa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.777092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cca019b3f684abb90d93e7b3518d33a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.777996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cca019b3f684abb90d93e7b3518d33a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.778634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cca019b3f684abb90d93e7b3518d33a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.788301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca847eacc0040b1af9a8c198d7b6daa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.799507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cca019b3f684abb90d93e7b3518d33a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.816082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cca019b3f684abb90d93e7b3518d33a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.818760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca847eacc0040b1af9a8c198d7b6daa'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:25.846618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 933/1864] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:25 2022] DELETE /identity/v3/users/2cca019b3f684abb90d93e7b3518d33a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:25.846618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.846992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 932/1865] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:25 2022] DELETE /identity/v3/users/7ca847eacc0040b1af9a8c198d7b6daa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:25.846992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:25.849716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.858955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:25.969736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f3811-3724-48f6-9af8-210adbfc6567 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:25.977570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:25.978247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:25.978525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:25.978838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:25.979576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:25.983339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d1cf1-8aaf-4202-ac7f-7af81e47163c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.020710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f403f6-7835-4a10-bd3b-eb6e733a1a60 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.029788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.030475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.030762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.031113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] PATH_INFO: `/v3/users/241de1910c7d4be99e36c08bff7ed233` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.033060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241de1910c7d4be99e36c08bff7ed233)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.035222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.042322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 933/1866] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:25 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:26.050141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.050642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.051098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.083697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:26.085186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.126351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241de1910c7d4be99e36c08bff7ed233'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.127341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241de1910c7d4be99e36c08bff7ed233'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.128232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241de1910c7d4be99e36c08bff7ed233'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.154443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241de1910c7d4be99e36c08bff7ed233'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.165318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17f8ec9e-5184-4bef-8b5b-c0d609d07e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241de1910c7d4be99e36c08bff7ed233'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.192825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 934/1867] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:26.193352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 934/1868] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:25 2022] DELETE /identity/v3/users/241de1910c7d4be99e36c08bff7ed233 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:26.198104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.198104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.199742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c779d-476b-4f27-8927-d43b16875cce None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.200254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c779d-476b-4f27-8927-d43b16875cce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.200597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c779d-476b-4f27-8927-d43b16875cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.256766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0bb65-4402-4adc-a2dd-14991b2c8482 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.256939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-038c779d-476b-4f27-8927-d43b16875cce None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:26.258183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-038c779d-476b-4f27-8927-d43b16875cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.275152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:26.308750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:26.351850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 935/1869] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:26.353160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c779d-476b-4f27-8927-d43b16875cce None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.354855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-038c779d-476b-4f27-8927-d43b16875cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.360329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.361201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.361743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.362028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.362738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.372104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.407992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 935/1870] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:26 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:26.407992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.411865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.432763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c779d-476b-4f27-8927-d43b16875cce None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.440606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.441598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.441754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.442493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.469753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.471417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.482888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 936/1871] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:26.483938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.506361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1d8f4-7476-4466-b196-84d2170a0847 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.520404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.521693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.522159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.522767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.547730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.549321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.568805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15213c37-9442-462f-aac2-5b1dde2909c2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.572888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 937/1872] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:26.574099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.575615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.580138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.581210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.581848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.582900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.589548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.602187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77a80b-115e-4557-a7af-be046bf4c2ab service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.616014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.616796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.617087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.617460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] PATH_INFO: `/v3/projects/b926e12a25c54c6183196eb72a1c62f0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.618832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b926e12a25c54c6183196eb72a1c62f0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.620925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.712481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.719886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.735166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 936/1873] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:26.736327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.747113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b926e12a25c54c6183196eb72a1c62f0', 'request_id': 'req-82c4af13-2edd-4f79-985b-2db4888e7f80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.754500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea1b7-4ccf-4b47-b07a-8d7dc038a7af service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:26.765141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b926e12a25c54c6183196eb72a1c62f0', 'request_id': 'req-82c4af13-2edd-4f79-985b-2db4888e7f80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.782199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b926e12a25c54c6183196eb72a1c62f0', 'request_id': 'req-82c4af13-2edd-4f79-985b-2db4888e7f80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.802864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] The token cache is being invalidate because project b926e12a25c54c6183196eb72a1c62f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:26.803263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.805048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:26.806854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 938/1874] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:26 2022] DELETE /identity/v3/projects/b926e12a25c54c6183196eb72a1c62f0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:26.825618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.828595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:26.914692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:26.915471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:26.915763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:26.916969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:26.917697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:26.926126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:26.926391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:26.963509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 937/1875] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:26.968076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:26.973992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.019163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030b8bf-d893-4df8-8643-5dfc3f7fbb1a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.041038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.041719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.042008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.042321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] PATH_INFO: `/v3/projects/cc42fdb05d73451d86e9b4de919cc23b/users/da378755be3a4db8b5c178ff3098de5d/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.057183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4af13-2edd-4f79-985b-2db4888e7f80 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.062997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:27.073615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.075743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.076166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.077574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] PATH_INFO: `/v3/users/74ff8850b86b4edcb942106bb3b33b9a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.081260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc42fdb05d73451d86e9b4de919cc23b, user_id=da378755be3a4db8b5c178ff3098de5d, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.082166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ff8850b86b4edcb942106bb3b33b9a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.087337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:27.089032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:27.113281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 938/1876] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:26 2022] PUT /identity/v3/projects/cc42fdb05d73451d86e9b4de919cc23b/users/da378755be3a4db8b5c178ff3098de5d/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:27.118914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:27.199680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ff8850b86b4edcb942106bb3b33b9a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.203984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ff8850b86b4edcb942106bb3b33b9a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.208114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ff8850b86b4edcb942106bb3b33b9a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.237365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ff8850b86b4edcb942106bb3b33b9a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.247633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ed66-7783-4804-898b-c07e4a1df358 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.256319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.257416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.257881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.258345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.259306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.261381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:27.262156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ff8850b86b4edcb942106bb3b33b9a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.284221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 939/1877] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:27.288392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:27.290076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 939/1878] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:26 2022] DELETE /identity/v3/users/74ff8850b86b4edcb942106bb3b33b9a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:27.292645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.323895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985ce6a-f851-41b7-919c-439178bd8663 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.329483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:27.332190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.578367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde6395-02f3-4b36-800b-5d032e118fbe admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.592090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.593592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.594399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.594847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] PATH_INFO: `/v3/projects/cc42fdb05d73451d86e9b4de919cc23b/users/da378755be3a4db8b5c178ff3098de5d/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.595566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.596389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.596807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.597178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] PATH_INFO: `/v3/projects/ae4d1034b64d4c2d8ab38060db9c81ad` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.598368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc42fdb05d73451d86e9b4de919cc23b, user_id=da378755be3a4db8b5c178ff3098de5d, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.599267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4d1034b64d4c2d8ab38060db9c81ad)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.602021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:27.604182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6c19-22b3-4352-b97d-328a4b8f3690 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:27.637971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 940/1879] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:27 2022] PUT /identity/v3/projects/cc42fdb05d73451d86e9b4de919cc23b/users/da378755be3a4db8b5c178ff3098de5d/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:27.640000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.640496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.640815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.727545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] MFA Rules not processed for user `da378755be3a4db8b5c178ff3098de5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:27.730919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.747853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:27.750762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4d1034b64d4c2d8ab38060db9c81ad', 'request_id': 'req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.762754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4d1034b64d4c2d8ab38060db9c81ad', 'request_id': 'req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.786610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4d1034b64d4c2d8ab38060db9c81ad', 'request_id': 'req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.817782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] The token cache is being invalidate because project ae4d1034b64d4c2d8ab38060db9c81ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:27.818179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.819059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:27.823587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 940/1880] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:27 2022] DELETE /identity/v3/projects/ae4d1034b64d4c2d8ab38060db9c81ad => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:27.828467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:27.830068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.906969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 941/1881] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:27.914757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:27.916353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:27.927063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:27.970728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bc82-bc26-4dcd-a6b4-15a805dd9f82 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:27.984122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:27.985874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:27.986329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:27.986643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] PATH_INFO: `/v3/projects/a696e9337b9849eeb2cf43ab4e6fd1a6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:27.989225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a696e9337b9849eeb2cf43ab4e6fd1a6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:27.993518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:28.054744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c868-f5e8-4e50-8a47-3f0b2c9fc650 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:28.062874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:28.063699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.064085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.064461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] PATH_INFO: `/v3/users/fc8939bb37d644af9a2ca4f7cac91fc6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.066707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8939bb37d644af9a2ca4f7cac91fc6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:28.069134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:28.115995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a696e9337b9849eeb2cf43ab4e6fd1a6', 'request_id': 'req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.133885 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a696e9337b9849eeb2cf43ab4e6fd1a6', 'request_id': 'req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.159324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a696e9337b9849eeb2cf43ab4e6fd1a6', 'request_id': 'req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.159426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8939bb37d644af9a2ca4f7cac91fc6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.161790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8939bb37d644af9a2ca4f7cac91fc6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.167972 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8939bb37d644af9a2ca4f7cac91fc6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.179571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] The token cache is being invalidate because project a696e9337b9849eeb2cf43ab4e6fd1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:28.180262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.181459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.184328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 941/1882] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:27 2022] DELETE /identity/v3/projects/a696e9337b9849eeb2cf43ab4e6fd1a6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:28.187425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:28.188556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:28.190182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8939bb37d644af9a2ca4f7cac91fc6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.213579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8939bb37d644af9a2ca4f7cac91fc6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.235122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 942/1883] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:27 2022] DELETE /identity/v3/users/fc8939bb37d644af9a2ca4f7cac91fc6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:28.238432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:28.238432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:28.268882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ca3d1-3f99-4230-8bb0-b651fe1b8c17 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:28.299500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:28.349410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf99f92-87b8-4aa0-a527-7b4a82faee0c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:28.361355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:28.362573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.364443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.364717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] PATH_INFO: `/v3/projects/2cbb2fe267f342ef910c120be38bd432` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.367470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbb2fe267f342ef910c120be38bd432)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:28.368346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:28.369884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.370268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.370706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.373351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:28.374959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:28.438070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:28.562326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbb2fe267f342ef910c120be38bd432', 'request_id': 'req-3ec92fa7-e462-48d8-a482-25c016fd8482'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.569814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:28.572253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:28.582531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbb2fe267f342ef910c120be38bd432', 'request_id': 'req-3ec92fa7-e462-48d8-a482-25c016fd8482'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.590003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 942/1884] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:28.600405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbb2fe267f342ef910c120be38bd432', 'request_id': 'req-3ec92fa7-e462-48d8-a482-25c016fd8482'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.606106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:28.609207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:28.647869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb1e18-f912-475a-9e2c-722fc185999f service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:28.649283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] The token cache is being invalidate because project 2cbb2fe267f342ef910c120be38bd432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:28.650221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.651947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3ec92fa7-e462-48d8-a482-25c016fd8482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.656957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 943/1885] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:28 2022] DELETE /identity/v3/projects/2cbb2fe267f342ef910c120be38bd432 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:28.668298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af161541-1a1c-4852-9595-097188f9620a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.671236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af161541-1a1c-4852-9595-097188f9620a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.672379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af161541-1a1c-4852-9595-097188f9620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.722238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-af161541-1a1c-4852-9595-097188f9620a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:28.730022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af161541-1a1c-4852-9595-097188f9620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:28.796154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:28.797048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.797208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.797367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] PATH_INFO: `/v3/users/cbba50a7a0b6432ea901b0a59a88f4ac` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.802182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbba50a7a0b6432ea901b0a59a88f4ac)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:28.804042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:28.915388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbba50a7a0b6432ea901b0a59a88f4ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.916169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbba50a7a0b6432ea901b0a59a88f4ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.916971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbba50a7a0b6432ea901b0a59a88f4ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:28.930863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 944/1886] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:28.933793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:28.934072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:28.934332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:28.964047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbba50a7a0b6432ea901b0a59a88f4ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.009986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbba50a7a0b6432ea901b0a59a88f4ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.018038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:29.018754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:29.021044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:29.069990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 943/1887] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:28 2022] DELETE /identity/v3/users/cbba50a7a0b6432ea901b0a59a88f4ac => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:29.070687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 945/1888] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:29.073421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:29.176725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:29.189624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:29.221649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4dcff-46ef-42e5-ab7f-132f0fdad59c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:29.294275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c8f66-51ed-4f8a-91ac-067df569261b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:29.324125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:29.325207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:29.340183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:29.340183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:29.340183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:29.340183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:29.340183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:29.398932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 944/1889] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:29.400424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:29.425499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04c542-18db-4db7-a431-983b5bf38d53 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:29.445449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:29.445749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:29.445749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:29.446031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:29.446189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:29.446330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:29.446462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] PATH_INFO: `/v3/projects/0697d182f30540d198fea671f634035d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:29.446598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:29.446598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:29.446867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0697d182f30540d198fea671f634035d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:29.448277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:29.458007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:29.568610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 945/1890] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:29 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:29.575269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:29.727103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76aeb3-2fad-4208-a75e-aacedb48ef1f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:29.769572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:29.780709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0697d182f30540d198fea671f634035d', 'request_id': 'req-7649f249-9930-4680-9f48-c37eac50af69'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.833904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0697d182f30540d198fea671f634035d', 'request_id': 'req-7649f249-9930-4680-9f48-c37eac50af69'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.878011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0697d182f30540d198fea671f634035d', 'request_id': 'req-7649f249-9930-4680-9f48-c37eac50af69'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.898298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:29.899127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:29.899611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:29.899611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:29.900144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:29.905077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:29.908311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] The token cache is being invalidate because project 0697d182f30540d198fea671f634035d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:29.908781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.909420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7649f249-9930-4680-9f48-c37eac50af69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:29.915480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 946/1891] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:29 2022] DELETE /identity/v3/projects/0697d182f30540d198fea671f634035d => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:29.917184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cae5-9942-4eba-9285-be75c0a9afd9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:29.917508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cae5-9942-4eba-9285-be75c0a9afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:29.917779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07cae5-9942-4eba-9285-be75c0a9afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:29.960184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:29.983408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8c07cae5-9942-4eba-9285-be75c0a9afd9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:29.983761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 946/1892] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:29 2022] POST /identity/v3/users => generated 287 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:29.983908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8c07cae5-9942-4eba-9285-be75c0a9afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:29.991056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:29.994583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.016945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 947/1893] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:30.025074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.025698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.026369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.049786 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43389e0-c7fb-45f2-80e9-54f2319a698d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.072113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.073686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.074288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.074948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.077802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.085174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.103323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:30.105606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.141668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 947/1894] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:30.143772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.159732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.160657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 948/1895] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:30.164990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.184545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc420ca-b81c-4b8a-9ff9-137131835761 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.192349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.193218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.193677 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.194147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.195348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.198332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.214870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 949/1896] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:30.216689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.231119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400899-ab24-4c78-b104-d58529b0cdd4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.236938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.238631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.238936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.239414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.240961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:30.241302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.249140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.250541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893b1c1-43b6-43fa-8c3f-6fbfc43f4d71 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.281678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.284661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.289537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 950/1897] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:30.290383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.291881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] PATH_INFO: `/v3/projects/b12a2742a7fa441faff71194dda1857e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.292194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.303345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12a2742a7fa441faff71194dda1857e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.307440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.321240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da932cb7-1bad-4109-8ca4-913b6df8f776 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.338119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.341018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.341594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.342160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] PATH_INFO: `/v3/projects/5f7b5eb7fa894771847e56f7d2920e7f/users/03066eef225f425e8bc9e05934f4f7dd/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.377267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7b5eb7fa894771847e56f7d2920e7f, user_id=03066eef225f425e8bc9e05934f4f7dd, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.398068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ead80b-5ca5-4047-99ba-23f54078311c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.449432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 951/1898] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:30 2022] PUT /identity/v3/projects/5f7b5eb7fa894771847e56f7d2920e7f/users/03066eef225f425e8bc9e05934f4f7dd/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:30.452313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65471e-5ef0-4ab9-a7da-9803eb0ec178 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.454846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65471e-5ef0-4ab9-a7da-9803eb0ec178 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.455442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65471e-5ef0-4ab9-a7da-9803eb0ec178 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.464206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 952/1899] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:34:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:34:30.465794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65471e-5ef0-4ab9-a7da-9803eb0ec178 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.477737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12a2742a7fa441faff71194dda1857e', 'request_id': 'req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:30.500723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12a2742a7fa441faff71194dda1857e', 'request_id': 'req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:30.517665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12a2742a7fa441faff71194dda1857e', 'request_id': 'req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:30.546280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] The token cache is being invalidate because project b12a2742a7fa441faff71194dda1857e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:30.548348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:30.551473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff64ea12-ceec-4692-a98b-4a79a5ba2daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:30.556622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 948/1900] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:30 2022] DELETE /identity/v3/projects/b12a2742a7fa441faff71194dda1857e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:30.561969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea5cd-9323-4e73-a7ad-b02ef25f99cc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.563243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea5cd-9323-4e73-a7ad-b02ef25f99cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.564003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea5cd-9323-4e73-a7ad-b02ef25f99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.618949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c50ea5cd-9323-4e73-a7ad-b02ef25f99cc None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:30.621096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c50ea5cd-9323-4e73-a7ad-b02ef25f99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.701910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65471e-5ef0-4ab9-a7da-9803eb0ec178 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:30.717292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:30.719817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.721979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.722395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.724940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:30.732038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404729-17ee-4fb5-905c-73ed6d7323c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:30.772462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 949/1901] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:30.774800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.775228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.776051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.827067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:30.828469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.847039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 953/1902] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:30 2022] POST /identity/v3/projects => generated 355 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:30.852384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:30.854120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:30.854932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:30.925128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:30.928454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:30.972069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 950/1903] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:30.975386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:30.977956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.004725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:31.076958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:31.099396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 954/1904] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:31.100987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.110872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.153435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cee1f-c679-425f-a1a2-1f0a6dd7aa5a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.171784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ada6-8ccd-4f1e-b1a3-1827e5f00f90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.183065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.184309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.185281 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.186690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.195526 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.200615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.277315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 955/1905] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:31 2022] POST /identity/v3/users => generated 278 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:31.286112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.298736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.332456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.345926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.347315 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.347799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.399180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.401990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9224c0-4a9f-43fb-99cd-bf5f967bd8b4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.424663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 951/1906] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:31.425383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.426068 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.426616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.467850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:31.471759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.480074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4618b5-c27a-4f48-acdd-d6580b1a4f7a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.492167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 952/1907] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:31.495772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.502271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.504062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.504390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.504913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.519916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6e89-c0d2-4902-9600-598efc23b8c8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.526203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.529740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.537489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.540291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.540763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.541216 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.544732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.550334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.555854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 956/1908] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:31.558489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.563031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.592493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 953/1909] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:31.595096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.604492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093e23a-bd81-4b09-9e96-69441a1dc739 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.620736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba8fb-6b14-4007-ae3e-b071c5d196cb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.629809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.630956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.631559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.632037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.633503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:31.634097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.637548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.654928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.656470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.658414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.659164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] PATH_INFO: `/v3/users/e4c20761237140c4ae0732a1a2c6992b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.664569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c20761237140c4ae0732a1a2c6992b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.670392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 954/1910] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:31.670392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.674614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.710643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d37-c8da-47d7-a805-b2207b107655 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.741840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.743126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.744282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.744282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.745729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.750414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.801927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 955/1911] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:31.801927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.838562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe27cb4-5610-4f1c-8346-f94c4235239b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:31.859964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:31.861023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:31.861509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:31.861985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:31.863187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:31.867584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:31.889955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c20761237140c4ae0732a1a2c6992b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:31.890855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c20761237140c4ae0732a1a2c6992b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:31.891521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c20761237140c4ae0732a1a2c6992b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:31.905201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c20761237140c4ae0732a1a2c6992b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:31.931109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 956/1912] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:31 2022] POST /identity/v3/projects => generated 399 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:31.933002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.936760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:31.945156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c20761237140c4ae0732a1a2c6992b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:31.984808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 957/1913] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:31 2022] DELETE /identity/v3/users/e4c20761237140c4ae0732a1a2c6992b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:31.985736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:31.994615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:32.106126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaebe8-adea-4934-bb73-046c97d2ab31 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.116339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:32.119165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:32.190940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12f33a-c823-4f32-86ce-7658bff8e3dc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.219180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:32.222165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.222824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.223804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.225369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:32.230320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad6265-291a-423d-9ef1-bd8312dbd14b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:32.278452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:32.279780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.280351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.281182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] PATH_INFO: `/v3/projects/399620b7df6c4dff9701ef2bae08cf20/users/4833d27a22cb49d192e0b29d809d7936/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.324388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 958/1914] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:31 2022] POST /identity/v3/users => generated 300 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:32.324388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9321-2412-47bd-938e-6b738fa71be4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.324388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9321-2412-47bd-938e-6b738fa71be4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.324388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9321-2412-47bd-938e-6b738fa71be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.345458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=399620b7df6c4dff9701ef2bae08cf20, user_id=4833d27a22cb49d192e0b29d809d7936, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:32.355901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:32.416817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dedc9321-2412-47bd-938e-6b738fa71be4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:32.418117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dedc9321-2412-47bd-938e-6b738fa71be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:32.424333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 957/1915] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:31 2022] PUT /identity/v3/projects/399620b7df6c4dff9701ef2bae08cf20/users/4833d27a22cb49d192e0b29d809d7936/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:32.427573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:32.566123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 959/1916] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:32.567989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.568358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.568616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.603816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] MFA Rules not processed for user `4833d27a22cb49d192e0b29d809d7936`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:32.605279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:32.657319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae72b-8a1c-44b1-b836-15ef7b3cba0f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.667702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:32.669844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.670984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.672042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.673559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:32.678189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:32.722298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 960/1917] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:32.724091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:32.731225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 958/1918] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:32.736052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:32.750532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2a153-2b00-4652-8a03-00a0368f9c11 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.760387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:32.761608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.762806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.762969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fb03c-2109-4d81-bb26-d9bb8c7c4724 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.763121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.764538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:32.769241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:32.775929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:32.776580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:32.776856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:32.777129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:32.778372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:32.779777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:32.809747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 959/1919] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:32.811286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:32.813802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:32.863267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 961/1920] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:32 2022] POST /identity/v3/projects => generated 355 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:32.864562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:32.954551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ab1-f340-454a-9648-50bb39b83d7c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:32.962915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:33.026425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6e27-68c2-4a11-b195-e37525ad901d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:33.035651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.037527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.038134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.038560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] PATH_INFO: `/v3/projects/48e20559e586479c8a898c7108507e31/users/3d0e729ec9b041d290f2018845a884d7/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.045828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:33.065234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e20559e586479c8a898c7108507e31, user_id=3d0e729ec9b041d290f2018845a884d7, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.074090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.102574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 962/1921] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:32 2022] PUT /identity/v3/projects/48e20559e586479c8a898c7108507e31/users/3d0e729ec9b041d290f2018845a884d7/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:33.103896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.111616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.113015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.114078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.114701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.133393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.135342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.158065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 960/1922] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:33.158883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.160748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.180549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf71d-7cfe-44e4-be20-a09d4b046f09 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:33.286278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68cb6-7d44-4e1a-86a1-ce802db64c9c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:33.288049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.289005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.289537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.289998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] PATH_INFO: `/v3/users/3ef2ddbba9974f89a64f26b13fc7475f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.291900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef2ddbba9974f89a64f26b13fc7475f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.295527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.301445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.302258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.303964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.304810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.307007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.314626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea222999-39ca-4a63-a2a1-47f6055137f1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.370519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 963/1923] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:33 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:33.372538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb2e6-2f85-4cd8-aeb7-fcad432d405a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.373222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb2e6-2f85-4cd8-aeb7-fcad432d405a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.374458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb2e6-2f85-4cd8-aeb7-fcad432d405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.454346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ebabb2e6-2f85-4cd8-aeb7-fcad432d405a None None] MFA Rules not processed for user `3d0e729ec9b041d290f2018845a884d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:33.454346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ebabb2e6-2f85-4cd8-aeb7-fcad432d405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.482182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef2ddbba9974f89a64f26b13fc7475f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:33.487758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef2ddbba9974f89a64f26b13fc7475f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:33.489886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef2ddbba9974f89a64f26b13fc7475f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:33.518055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef2ddbba9974f89a64f26b13fc7475f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:33.533292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef2ddbba9974f89a64f26b13fc7475f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:33.562290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 961/1924] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:33 2022] DELETE /identity/v3/users/3ef2ddbba9974f89a64f26b13fc7475f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:33.563928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.566665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.614902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 964/1925] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:33.618631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.618809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.619394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.680865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] MFA Rules not processed for user `03066eef225f425e8bc9e05934f4f7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:33.683955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.685372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:33.706473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216285d-9213-4ddf-bc24-bbb107a422db admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:33.714680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.716276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.716750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.717159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.718067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.721146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c57a7-895c-4b5f-9ce6-bfdcd9635c7c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.738548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 962/1926] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:33.742098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.742098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.742098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.777228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:33.778907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.779521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:33.807155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 963/1927] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:33.807155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.807155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.825331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a465a-b1a6-4dfc-b2c0-aee207a97aac None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:33.834991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:33.836052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:33.836616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:33.838282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:33.839986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:33.844208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:33.917120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 965/1928] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:33.923889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.924077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 964/1929] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:33 2022] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:33.926006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:33.928353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:33.951665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd5beb-7d55-45f1-86a9-22e1687f5750 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.055700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dc9e-a752-4bf0-a271-8cfa22ebc4de admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.064905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.065935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.066427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.067225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.076568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.078647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.079280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.080351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] PATH_INFO: `/v3/projects/37edabc6752c4bafa5980e4bb89650cc/users/8cc1dd3e415646e2bde21f7982c2e2c5/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.107409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.110217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.111021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37edabc6752c4bafa5980e4bb89650cc, user_id=8cc1dd3e415646e2bde21f7982c2e2c5, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.114244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.132324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 966/1930] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:33 2022] PUT /identity/v3/projects/37edabc6752c4bafa5980e4bb89650cc/users/8cc1dd3e415646e2bde21f7982c2e2c5/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:34.134123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.136968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.139964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 965/1931] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:34.141211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.163034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfffb39-7d88-4f53-9243-c277752ebb6a service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.341078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.341929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.342219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.342666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.343695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.346430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.349771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326112d-ba01-44ae-9cc2-7bf33c6e0925 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.355358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.356374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.356874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.357351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] PATH_INFO: `/v3/projects/e4df5769cf8f40418ebcfd25569180f3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.359177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4df5769cf8f40418ebcfd25569180f3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.361768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.378766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 966/1932] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:34 2022] POST /identity/v3/users => generated 307 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:34.378766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.378766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.394623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c41b-6bc8-4e28-939f-b9ffb5e51ed4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.400462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.401111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.401390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.401656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.403407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.404385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.453178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 967/1933] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:34 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:34.454440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.465617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4df5769cf8f40418ebcfd25569180f3', 'request_id': 'req-8eba509f-cd99-4a66-9fe6-29e90247a0d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.494859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4df5769cf8f40418ebcfd25569180f3', 'request_id': 'req-8eba509f-cd99-4a66-9fe6-29e90247a0d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.499944 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:34.503421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:34.518616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4df5769cf8f40418ebcfd25569180f3', 'request_id': 'req-8eba509f-cd99-4a66-9fe6-29e90247a0d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.544251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] The token cache is being invalidate because project e4df5769cf8f40418ebcfd25569180f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:34.544606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.546207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.548074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 967/1934] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:34 2022] DELETE /identity/v3/projects/e4df5769cf8f40418ebcfd25569180f3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:34.549359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.551484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.593775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12005-41f1-4461-bb07-ea1327786b0a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.599465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.600241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.600635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.600974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.601776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.604094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.621739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 968/1935] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:34.622760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.625056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.662416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce8b4-b00f-4f11-97a4-62011b35722d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.676555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.679709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.680656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.683252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.684617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.688425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba509f-cd99-4a66-9fe6-29e90247a0d2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.695030 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.701252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.702828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.703164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.703486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.704508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.708298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.734467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 969/1936] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:34 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:34.736383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.738136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 968/1937] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:34.739057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.741122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.742606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:34.756869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f398b-cf5c-4731-8046-62141f2ff276 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.758080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaca94-015d-41df-ad42-a88d2b0d395e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.762219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.763046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:34.763221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.763380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.763742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] PATH_INFO: `/v3/projects/37edabc6752c4bafa5980e4bb89650cc/users/8cc1dd3e415646e2bde21f7982c2e2c5/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.763982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:34.764364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:34.764705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] PATH_INFO: `/v3/users/6e3557a675be4b0e8f587699aea04e00` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:34.765963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3557a675be4b0e8f587699aea04e00)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.766073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=37edabc6752c4bafa5980e4bb89650cc, user_id=8cc1dd3e415646e2bde21f7982c2e2c5, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:34.768850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.770519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:34.784844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 969/1938] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:34 2022] PUT /identity/v3/projects/37edabc6752c4bafa5980e4bb89650cc/users/8cc1dd3e415646e2bde21f7982c2e2c5/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:34.796715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.847587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3557a675be4b0e8f587699aea04e00'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.849747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3557a675be4b0e8f587699aea04e00'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.850831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3557a675be4b0e8f587699aea04e00'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.874428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3557a675be4b0e8f587699aea04e00'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.885874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3557a675be4b0e8f587699aea04e00'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:34.902130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21db-7e68-4ff2-8aaa-447515c3a9cd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:34.904383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 970/1939] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:34 2022] DELETE /identity/v3/users/6e3557a675be4b0e8f587699aea04e00 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:34.905616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:34.915708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.017438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.018152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.018915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.018915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.019619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.022036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.026386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f7e49-0def-4355-bc1f-e12a5a904398 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.033097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.033769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.034073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.034353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] PATH_INFO: `/v3/projects/95d7f13dcf8348c7a7372435da84dbac/users/8ae454ab12e34e089d5879d891974ccf/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.039226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 970/1940] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:35.039226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.039226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.057310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74427a-00ce-45c7-bb11-2b2f7598902f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.062062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d7f13dcf8348c7a7372435da84dbac, user_id=8ae454ab12e34e089d5879d891974ccf, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.064113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.065036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.065446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.065980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] PATH_INFO: `/v3/projects/688bdfc69a36410b976747b2a3e25766` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.066093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049779-affe-469a-b76a-f259eca7ed71 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.067851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688bdfc69a36410b976747b2a3e25766)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.070269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.073777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.096891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 971/1941] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:34 2022] PUT /identity/v3/projects/95d7f13dcf8348c7a7372435da84dbac/users/8ae454ab12e34e089d5879d891974ccf/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:35.099284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.099578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.100024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.110751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.142806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] MFA Rules not processed for user `8cc1dd3e415646e2bde21f7982c2e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:35.144256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.170461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688bdfc69a36410b976747b2a3e25766', 'request_id': 'req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.194026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688bdfc69a36410b976747b2a3e25766', 'request_id': 'req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.206521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688bdfc69a36410b976747b2a3e25766', 'request_id': 'req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.225214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] The token cache is being invalidate because project 688bdfc69a36410b976747b2a3e25766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:35.225214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.225214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.226068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 971/1942] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:35 2022] DELETE /identity/v3/projects/688bdfc69a36410b976747b2a3e25766 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:35.233412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.233412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.290189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 972/1943] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:35.291982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.294247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.382629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cc590-5a1a-47ae-a92e-3ddf26dbbbd2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.389169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.389891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.390168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.390452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] PATH_INFO: `/v3/projects/261a8878656848d9979ade71080707f8/users/3944359c5f034fef912118975c696d94/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.430331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a8878656848d9979ade71080707f8, user_id=3944359c5f034fef912118975c696d94, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.438784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.464395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 972/1944] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:35 2022] PUT /identity/v3/projects/261a8878656848d9979ade71080707f8/users/3944359c5f034fef912118975c696d94/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:35.465401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.473026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.485462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3aeb5-8e81-44c5-b55f-ffb90d7b18dc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.575902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.576529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.576803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.577129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.577822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.579770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.591899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 973/1945] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:35.592764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.597040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.631618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa249a-11be-491e-ae0e-debe333610e5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.644927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.645693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.645975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.646243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] PATH_INFO: `/v3/users/da378755be3a4db8b5c178ff3098de5d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.649520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=da378755be3a4db8b5c178ff3098de5d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.652521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.658747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.686912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:35.689227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64d2e-f4d9-4005-96c0-bd1fba21a1f6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.695834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.696847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.697301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.697909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.737761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da378755be3a4db8b5c178ff3098de5d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.738512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da378755be3a4db8b5c178ff3098de5d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.739149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da378755be3a4db8b5c178ff3098de5d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.749797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da378755be3a4db8b5c178ff3098de5d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.774974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da378755be3a4db8b5c178ff3098de5d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:35.801704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.803341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 973/1946] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:35 2022] DELETE /identity/v3/users/da378755be3a4db8b5c178ff3098de5d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:35.804414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.806114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.806487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.818859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 974/1947] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:35.819806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.832521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78b5a4-4be4-4a0d-b879-86ad6125152a service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.920889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc794-7f2b-4a34-93c2-15108ddb2ccc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.926564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.927549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.927835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.928203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] PATH_INFO: `/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.930121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a0002a33c34a5dbb73f9c4e035be45)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.933479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.941214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.942768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.943160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.943576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.944952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:35.946872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:35.972206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 975/1948] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:35.972206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:35.976384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:35.990813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f4858-b90c-4ec1-8b47-8a277aaea2b3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:35.995874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:35.996588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:35.996851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:35.997135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] PATH_INFO: `/v3/projects/95d7f13dcf8348c7a7372435da84dbac/users/8ae454ab12e34e089d5879d891974ccf/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:35.999611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d7f13dcf8348c7a7372435da84dbac, user_id=8ae454ab12e34e089d5879d891974ccf, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.002072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.014501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a0002a33c34a5dbb73f9c4e035be45', 'request_id': 'req-96574d34-e436-4615-981b-5b936df05232'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.016108 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 976/1949] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:35 2022] PUT /identity/v3/projects/95d7f13dcf8348c7a7372435da84dbac/users/8ae454ab12e34e089d5879d891974ccf/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:36.017040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.019310 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.030302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a0002a33c34a5dbb73f9c4e035be45', 'request_id': 'req-96574d34-e436-4615-981b-5b936df05232'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.039784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a0002a33c34a5dbb73f9c4e035be45', 'request_id': 'req-96574d34-e436-4615-981b-5b936df05232'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.057929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] The token cache is being invalidate because project a2a0002a33c34a5dbb73f9c4e035be45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:36.058153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.059330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.062933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 974/1950] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:35 2022] DELETE /identity/v3/projects/a2a0002a33c34a5dbb73f9c4e035be45 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:36.063999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.068215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.092681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe8f3-179e-4ce6-8129-0a0b3357eb2b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.097319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:36.098043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.098416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.098774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.101298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.111773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:36.130642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:36.177215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574d34-e436-4615-981b-5b936df05232 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.197717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.199752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36558c06-d0c7-4f9b-b53c-c0c8c9d9ecf8 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.213507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 977/1951] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:36.215158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.215475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.215808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.261275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] MFA Rules not processed for user `8ae454ab12e34e089d5879d891974ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:36.264147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.320457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:36.321215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.321546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.321819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] PATH_INFO: `/v3/projects/261a8878656848d9979ade71080707f8/users/3944359c5f034fef912118975c696d94/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.324135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a8878656848d9979ade71080707f8, user_id=3944359c5f034fef912118975c696d94, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.330299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a382-8404-44b7-89c4-96273404ca45 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.349504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 975/1952] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:36 2022] PUT /identity/v3/projects/261a8878656848d9979ade71080707f8/users/3944359c5f034fef912118975c696d94/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:36.349504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.349504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.349504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.404294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:36.407865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.412645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 978/1953] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:36.418040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.419574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.435794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c46e0-c4b4-4d8e-a95b-faf81211959f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.523959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:36.524895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.525383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.525937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] PATH_INFO: `/v3/projects/cc42fdb05d73451d86e9b4de919cc23b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.526847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 976/1954] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:36.528000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.529498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.534469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc42fdb05d73451d86e9b4de919cc23b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.538241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.610860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac39d-cf4b-4cf5-a9da-563d639b393c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.630250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:36.633482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc42fdb05d73451d86e9b4de919cc23b', 'request_id': 'req-576c3902-2961-40e8-afc3-50210044a057'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.640810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:36.646341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc42fdb05d73451d86e9b4de919cc23b', 'request_id': 'req-576c3902-2961-40e8-afc3-50210044a057'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.658562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc42fdb05d73451d86e9b4de919cc23b', 'request_id': 'req-576c3902-2961-40e8-afc3-50210044a057'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.702121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] The token cache is being invalidate because project cc42fdb05d73451d86e9b4de919cc23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:36.702765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.703785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-576c3902-2961-40e8-afc3-50210044a057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:36.709537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 979/1955] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:36 2022] DELETE /identity/v3/projects/cc42fdb05d73451d86e9b4de919cc23b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:36.711855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb2df-b1be-4ed3-9330-32335649f969 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.712364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb2df-b1be-4ed3-9330-32335649f969 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.712897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bb2df-b1be-4ed3-9330-32335649f969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.716227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:36.716964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.717245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.717539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.721472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.740589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a03bb2df-b1be-4ed3-9330-32335649f969 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:36.743360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a03bb2df-b1be-4ed3-9330-32335649f969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.836769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.838966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.850900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 980/1956] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:36.852551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdfdf-0169-409b-b4b6-391b610b944d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.852843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdfdf-0169-409b-b4b6-391b610b944d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.853358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cdfdf-0169-409b-b4b6-391b610b944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.867292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 977/1957] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:36 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:36.870724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.887994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120120-51d9-46e0-8346-62212e0f89ae service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.891575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-526cdfdf-0169-409b-b4b6-391b610b944d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:36.894193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-526cdfdf-0169-409b-b4b6-391b610b944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.899245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:36.910733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 981/1958] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:36.911099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.911842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.912186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.912898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:36.914769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:36.920684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:36.921795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:36.922595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:36.923485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:36.965549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 978/1959] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:36.966534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:36.969710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:36.971871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:36.988470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e1a4d-59a2-4779-a07e-d5fa0d5251a9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:36.991165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 982/1960] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:36.995926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.009645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.012023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.012511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.012934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.015648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.017957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.025378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb3b8-b00d-4d2e-b08c-49fd631506f9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.053672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.054482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.054729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.055125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.055913 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:37.056720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.058018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.077167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 983/1961] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:37.078203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.080111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:37.106671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d50d6a-2822-4e15-86a9-05e982292141 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.111774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.112515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.113197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.113197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.115022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:37.119829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 979/1962] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:36 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:37.121128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.198969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.200614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.212323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 984/1963] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:37.213061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.213543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02f92-d62c-487b-a585-ee178e7ba899 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.218966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.219909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.220035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.220330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.221138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.223114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.226397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72190b3-0da9-4fef-a0f0-45e1750b308b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.236425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.237080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.237464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.237740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.238383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.240376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.260477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 980/1964] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:37.261566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.278615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 985/1965] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:37.287181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.293089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:37.309228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8a816-a8f4-40d0-a516-9ac91b4a9493 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.353154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591b3c-9aaf-4e87-b948-469e1e840c13 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.354094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:37.367127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.368314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.368673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.369079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.370242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.376514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.411886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.412954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.413408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.413882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.415969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.422954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 981/1966] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:37.423311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.438577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 986/1967] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:37.438896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.441099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.452933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29019bd-9107-4a25-abb0-04e7fa2066c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.461037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.461846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.462280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.462678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.463938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.466736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.498701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 987/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:37.503114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.504982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57ecc-da3e-47a3-acaa-5017b62185ef admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.518728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.520276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.520841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.521367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.523096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.527721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e4a7b-9f0a-4272-8b9b-a46b83ef779a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.528124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.553028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 982/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:37.555921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.556929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.558989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.561000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.561493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] PATH_INFO: `/v3/projects/82b3b4ba263c43e39514b5e52592aea0/users/776192c3157c4d23b12f0a491ef12f36/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.578075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97def3-9e41-43d3-b0f6-6eeb017facca admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.590093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.591397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.594286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.594914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.596391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.600166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.620242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3b4ba263c43e39514b5e52592aea0, user_id=776192c3157c4d23b12f0a491ef12f36, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.624137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 983/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:37.625317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9816a-3f2d-451c-bce5-d9fb512e1cac admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.625465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:37.650707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130853c-3cf7-4ae0-be9d-d3cca382244d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:37.663091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 988/1971] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:37 2022] PUT /identity/v3/projects/82b3b4ba263c43e39514b5e52592aea0/users/776192c3157c4d23b12f0a491ef12f36/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:37.664929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40be23-057d-4b2e-be4f-710f95f6ddbe None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.666567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40be23-057d-4b2e-be4f-710f95f6ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.666898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40be23-057d-4b2e-be4f-710f95f6ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.685969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:37.704103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.706785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.708206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] PATH_INFO: `/v3/projects/955912ff305a49bb83693084634a09ff/users/554df0af7a504829a3f406e7585cded1/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.757105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bd40be23-057d-4b2e-be4f-710f95f6ddbe None None] MFA Rules not processed for user `3944359c5f034fef912118975c696d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:37.759064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bd40be23-057d-4b2e-be4f-710f95f6ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:37.763273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955912ff305a49bb83693084634a09ff, user_id=554df0af7a504829a3f406e7585cded1, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:37.783721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff78cae-3d73-46cc-8667-080e8c08eb69 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:37.827032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 984/1972] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:37 2022] PUT /identity/v3/projects/955912ff305a49bb83693084634a09ff/users/554df0af7a504829a3f406e7585cded1/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:37.841339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac50d-5290-4177-93f9-f9e162f1fcb9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.841633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac50d-5290-4177-93f9-f9e162f1fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.841884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac50d-5290-4177-93f9-f9e162f1fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:37.928311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e9bac50d-5290-4177-93f9-f9e162f1fcb9 None None] MFA Rules not processed for user `776192c3157c4d23b12f0a491ef12f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:37.929713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e9bac50d-5290-4177-93f9-f9e162f1fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:37.946651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 989/1973] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:37.961131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:37.961131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:37.961347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.016731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] MFA Rules not processed for user `554df0af7a504829a3f406e7585cded1`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:38.018036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:38.065356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 985/1974] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:38.067081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.067401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.067675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.090651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] MFA Rules not processed for user `03066eef225f425e8bc9e05934f4f7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:38.092086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:38.116361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 990/1975] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:38.117593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.128514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:38.181361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:38.189277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 986/1976] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:38.190093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.244341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a66800-3ea9-491a-a390-ab2ad0f961c6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.250034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.250735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.251026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.252417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.253166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.255179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.292924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 991/1977] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:38 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:38.297628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.323070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf2eb5-1938-4670-8b36-e4db93e43d73 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.392553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a67cc-c305-440d-9c40-5c521b5b0a77 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.399184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.399184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.399184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.399805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.400430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.402437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.438285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.438285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.438285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.438285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.438746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.439411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 992/1978] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:38 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:38.440610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.440821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.442822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:38.497163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 987/1979] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:38 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:38.503493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.552669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e419e83-80d6-4620-9649-50236e94493a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.579710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:38.620279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a865a3-b074-4a64-92c3-c8820769dcf6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.637039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.639033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.639932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.640380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.642125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.644608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.652909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.653788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.654185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.654612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.657278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:38.658059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 988/1980] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:38.659242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.670766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a4fd-4d37-4c5e-8527-39717da582a7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.676785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.677843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.678383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.678800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.679940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.684061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.724752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 989/1981] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:38 2022] POST /identity/v3/users => generated 300 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:38.725859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.739332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.739332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.740215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c20dd-8e64-42cf-a1d5-e1f365e7cc1b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.747166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.748121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.748533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.748860 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] PATH_INFO: `/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57/users/1d2e10aac2d54fbdb424b5b3936a011c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.762785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:38.768515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 993/1982] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:38.770130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.773997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7b4ceb0bc34b5c95be5e2061349a57, user_id=1d2e10aac2d54fbdb424b5b3936a011c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.777117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.788022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7f46-8513-48b5-bd8e-736355cd0fd8 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.796245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.797120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.797531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.797869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.798629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.800586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.801667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 990/1983] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:38 2022] PUT /identity/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57/users/1d2e10aac2d54fbdb424b5b3936a011c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:38.806509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.819238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 994/1984] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:38.822116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.836359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62195d97-c46f-4271-be7a-d0d5dfbe725c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.921840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0e925-c2c7-4d62-97f5-0d709351a5a5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.930021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.931178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.931336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:38.931769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.931958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:38.932242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:38.932502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.932609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] PATH_INFO: `/v3/projects/29600354324b4ae3ace58ffd57a612a8/users/5ab53fa6b54043568939cf5b14f8fd89/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:38.933461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.935864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.947308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 991/1985] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:38.950983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29600354324b4ae3ace58ffd57a612a8, user_id=5ab53fa6b54043568939cf5b14f8fd89, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:38.952127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:38.955831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:38.970441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501813a3-b17a-4d79-98eb-6b405b4961cd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:38.983325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 995/1986] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:38 2022] PUT /identity/v3/projects/29600354324b4ae3ace58ffd57a612a8/users/5ab53fa6b54043568939cf5b14f8fd89/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:38.988894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:39.005985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:39.013403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.015337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.015470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] PATH_INFO: `/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57/users/1d2e10aac2d54fbdb424b5b3936a011c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.020991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7b4ceb0bc34b5c95be5e2061349a57, user_id=1d2e10aac2d54fbdb424b5b3936a011c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:39.026144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13cd6-63d2-4a5b-b71b-7a99c0325e12 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:39.057975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 992/1987] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:38 2022] PUT /identity/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57/users/1d2e10aac2d54fbdb424b5b3936a011c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:39.069330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb477b-2b35-4e78-901b-4ef90042c0a3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.069679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb477b-2b35-4e78-901b-4ef90042c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.070002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb477b-2b35-4e78-901b-4ef90042c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.086505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:39.154614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-57eb477b-2b35-4e78-901b-4ef90042c0a3 None None] MFA Rules not processed for user `1d2e10aac2d54fbdb424b5b3936a011c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:39.154736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d20d9-963a-4d67-b4de-7dc2f99a8462 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:39.164355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-57eb477b-2b35-4e78-901b-4ef90042c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:39.320829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:39.321902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.322032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.322272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.322987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:39.325453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:39.342556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 996/1988] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:39.349774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:39.370813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5056-372e-41c0-9e96-d6a2540970a8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:39.371156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 993/1989] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:39.374409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:39.375261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.375603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.375937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] PATH_INFO: `/v3/projects/29600354324b4ae3ace58ffd57a612a8/users/5ab53fa6b54043568939cf5b14f8fd89/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.378982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29600354324b4ae3ace58ffd57a612a8, user_id=5ab53fa6b54043568939cf5b14f8fd89, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:39.381790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:39.412417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 997/1990] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:39 2022] PUT /identity/v3/projects/29600354324b4ae3ace58ffd57a612a8/users/5ab53fa6b54043568939cf5b14f8fd89/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:39.416096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.416653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.417839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.461748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] MFA Rules not processed for user `5ab53fa6b54043568939cf5b14f8fd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:39.463580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:39.518230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:39.549399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 994/1991] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:39.565926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:39.656698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e5f8-afaa-4b59-b2f6-537c34494530 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:39.670025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:39.671882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.672667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.673773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.724523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:39.726621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:39.740684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3e69d-1aa1-408f-bb47-23bed4276c4b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:39.753104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:39.754516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:39.754894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:39.755297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:39.768341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:39.771089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:39.786269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 995/1992] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:34:39.842585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:39.847062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:39.849066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea25e9-7361-4c26-9b06-4e63d593d138 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:39.863708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 998/1993] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:40.031277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a97c-2eb7-4c57-8583-966ea69f69cb service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:40.041124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:40.041957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:40.042334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:40.042703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] PATH_INFO: `/v3/users/554df0af7a504829a3f406e7585cded1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:40.044263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554df0af7a504829a3f406e7585cded1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:40.047551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:40.162091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554df0af7a504829a3f406e7585cded1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:40.163374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554df0af7a504829a3f406e7585cded1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:40.164063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554df0af7a504829a3f406e7585cded1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:40.177175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554df0af7a504829a3f406e7585cded1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:40.193725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554df0af7a504829a3f406e7585cded1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:40.225534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 996/1994] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:39 2022] DELETE /identity/v3/users/554df0af7a504829a3f406e7585cded1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:40.230073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:40.230358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:40.230630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:40.277296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:40.289599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:40.304322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:40.382294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 999/1995] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:40.391010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:40.392637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:40.555851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:40.571326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92a1d3-45ce-470b-b6dc-37d66ec243e3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:40.578148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:40.578815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:40.579077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:40.579399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:40.593136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:40.595222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:40.608744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 997/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:41.094135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:41.096076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:41.132805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6fd12-2c10-4e97-bf2a-464f0eb38c4a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:41.146394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:41.147052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:41.147353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:41.147621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] PATH_INFO: `/v3/projects/955912ff305a49bb83693084634a09ff` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:41.151394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955912ff305a49bb83693084634a09ff)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:41.153396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:41.233079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955912ff305a49bb83693084634a09ff', 'request_id': 'req-36699036-0545-4003-afbd-1a19e277fae3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.244990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955912ff305a49bb83693084634a09ff', 'request_id': 'req-36699036-0545-4003-afbd-1a19e277fae3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.257651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955912ff305a49bb83693084634a09ff', 'request_id': 'req-36699036-0545-4003-afbd-1a19e277fae3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.291852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] The token cache is being invalidate because project 955912ff305a49bb83693084634a09ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:41.291852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.291852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.291852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1000/1997] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:41 2022] DELETE /identity/v3/projects/955912ff305a49bb83693084634a09ff => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:41.292134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:41.300588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352d8c4-b8af-43a2-837d-e750052af501 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:41.383795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:41.384423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:41.384806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:41.385493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] PATH_INFO: `/v3/users/5ab53fa6b54043568939cf5b14f8fd89` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:41.386703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab53fa6b54043568939cf5b14f8fd89)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:41.398430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:41.479668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab53fa6b54043568939cf5b14f8fd89'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.480427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab53fa6b54043568939cf5b14f8fd89'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.481126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab53fa6b54043568939cf5b14f8fd89'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.492380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab53fa6b54043568939cf5b14f8fd89'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.529095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7ad6b24-c212-4c38-909e-8751a0680ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab53fa6b54043568939cf5b14f8fd89'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:41.557875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 998/1998] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:41 2022] DELETE /identity/v3/users/5ab53fa6b54043568939cf5b14f8fd89 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:42.043366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.045732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:42.084608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699036-0545-4003-afbd-1a19e277fae3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.196292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.197227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.197857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.198127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] PATH_INFO: `/v3/projects/29600354324b4ae3ace58ffd57a612a8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.199953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29600354324b4ae3ace58ffd57a612a8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.202657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.277093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:42.295497 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29600354324b4ae3ace58ffd57a612a8', 'request_id': 'req-9f7b0963-d363-4541-99b1-20a9a8254115'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:42.307613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29600354324b4ae3ace58ffd57a612a8', 'request_id': 'req-9f7b0963-d363-4541-99b1-20a9a8254115'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:42.343406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29600354324b4ae3ace58ffd57a612a8', 'request_id': 'req-9f7b0963-d363-4541-99b1-20a9a8254115'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:42.371340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] The token cache is being invalidate because project 29600354324b4ae3ace58ffd57a612a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:42.371746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:42.372820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9f7b0963-d363-4541-99b1-20a9a8254115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:42.377204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1001/1999] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:42 2022] DELETE /identity/v3/projects/29600354324b4ae3ace58ffd57a612a8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:42.382063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.382347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.382621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.408537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:42.411081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:42.538623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 999/2000] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:42.550677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.550943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.551291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.581654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:42.582931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:42.591602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1002/2001] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:42.596093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.607106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2573f5-799d-4f56-8048-33df0af1e14d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.611931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.612672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.612944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.613215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.613870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:42.614174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.615850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.618589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:42.633644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1000/2002] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:42.638658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.652829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d701e-54b3-4278-a2b6-23f37685f8a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.658198 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.658831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.659361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.659521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.660165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.662144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.694630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1003/2003] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:42 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:42.699172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.710764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9242-417a-4f30-88f9-c48c84799e79 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.774999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.775745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.776027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.776301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.776953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.778917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.804757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1001/2004] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:42 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:42.809197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.825023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f7bf7-dd31-48ad-93c4-38882da9c317 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.831186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.833061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.833061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.833061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.833479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.836928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.851898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1004/2005] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:42.856564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.869110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed519-cfee-4794-9056-402fbdd4c03f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.877942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.879012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.880507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.881003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:42.882297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:42.885579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20c10-96a2-4902-8a9a-f9b5eb7fce12 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:42.938618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1002/2006] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:42.941550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:42.964280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e63f3-92c7-4268-8df4-831436be3ff9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:42.975184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:42.976636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:42.977210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:42.978021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] PATH_INFO: `/v3/projects/ac90b02a61d8443786d69b1b3f435a04/users/20281e13fd854c5d93f5ad567b96e95a/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.007004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac90b02a61d8443786d69b1b3f435a04, user_id=20281e13fd854c5d93f5ad567b96e95a, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:43.011440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:43.043054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1005/2007] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:42 2022] PUT /identity/v3/projects/ac90b02a61d8443786d69b1b3f435a04/users/20281e13fd854c5d93f5ad567b96e95a/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:43.059157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:43.059157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:43.059157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.167012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] MFA Rules not processed for user `20281e13fd854c5d93f5ad567b96e95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:43.168871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:43.251360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:43.253476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:43.299909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1003/2008] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:43.305416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:43.468526 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204623-e000-4353-8cac-f948c62b2e04 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:43.469364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4be14-49dd-4569-9c34-09b2d45b90b7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:43.481006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:43.482764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:43.482904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:43.483262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:43.483683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.483809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:43.484010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:43.484284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] PATH_INFO: `/v3/users/3d0e729ec9b041d290f2018845a884d7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.484826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:43.486110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0e729ec9b041d290f2018845a884d7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:43.487274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:43.489090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:43.511745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:43.547827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1004/2009] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:43 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:43.552931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:43.579291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0e729ec9b041d290f2018845a884d7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:43.579291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0e729ec9b041d290f2018845a884d7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:43.579910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0e729ec9b041d290f2018845a884d7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:43.632701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0e729ec9b041d290f2018845a884d7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:43.634292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:43.645185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08e2e115-a9b0-4330-9146-ec4b2bce916e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0e729ec9b041d290f2018845a884d7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:43.670357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1006/2010] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:43 2022] DELETE /identity/v3/users/3d0e729ec9b041d290f2018845a884d7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:43.681026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:43.681465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:43.681935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.733214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:43.734710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:43.742366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0719-60fb-4293-b7d4-85eaf9e3d41d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:43.832082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1007/2011] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:43.856845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:43.860765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:43.883734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:43.886194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:43.887178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:43.887799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:43.891463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:43.910181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:43.951266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1005/2012] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:43 2022] POST /identity/v3/users => generated 289 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:43.956413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:43.960647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:43.991290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d3fb-3357-4c37-8adc-a0604d0e5f34 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:43.999537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.000175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.000449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.000717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.001377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.005304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.067539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd2322-7ef8-495b-a808-4a3349a82b79 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.068869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1006/2013] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:44.070382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.088438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.089112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.089446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.089861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.107290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86194eef-23e1-43b9-afcf-fd30d36af39e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.117349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.119117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.124557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.125284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.127024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.127395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.129252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.143565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ebf9e-b138-401f-beaa-924c5764dfde admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.151851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1008/2014] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:44.165058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1007/2015] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:44.169309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.217016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846923-136f-4e89-bb27-8536155b6442 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.236063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.236795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.237053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.237357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] PATH_INFO: `/v3/projects/dd67f41604204ac78d7a4dbfad04967e/users/fc57fbc5e0dd4dfaa9a22db8c1b18f83/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.275277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd67f41604204ac78d7a4dbfad04967e, user_id=fc57fbc5e0dd4dfaa9a22db8c1b18f83, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.278139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.312152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1009/2016] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:44 2022] PUT /identity/v3/projects/dd67f41604204ac78d7a4dbfad04967e/users/fc57fbc5e0dd4dfaa9a22db8c1b18f83/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:44.325749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.326699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.327772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.399240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] MFA Rules not processed for user `fc57fbc5e0dd4dfaa9a22db8c1b18f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:44.400490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:44.562234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:44.595775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.598774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1008/2017] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:44.706291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378122-39be-4174-9478-660aa13b5e20 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.711587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.712517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.712904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.713323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.714013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.716407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.729295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:44.768071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.779654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1010/2018] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:44 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:44.781375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef165b62-ba0d-4583-9de8-6d3055faaa2c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.868183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.868809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.869136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.869339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.869973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.872154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.900155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1009/2019] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:44 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:44.906347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.919228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37f10-75d7-4376-a324-4f1101748c4f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:44.926612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:44.927648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:44.928375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:44.928829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:44.929702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:44.932280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:44.945941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1011/2020] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:44.950322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:44.987800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44519-4c88-45c5-aaa5-da4fe04e229e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.018535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.019331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.021136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.021436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] PATH_INFO: `/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b/users/af39f9bee06a473187191c0e339d4531/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.047787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c093bd9b254311a8ae94c2e8df5d2b, user_id=af39f9bee06a473187191c0e339d4531, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.050624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.071559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1010/2021] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:44 2022] PUT /identity/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b/users/af39f9bee06a473187191c0e339d4531/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:45.075835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.087814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7cf6-5f9c-46f6-811e-0407a11826b3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.167784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.168693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.169052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.170050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.170874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.172858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.198807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1012/2022] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:45.211243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.220320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.229400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.231337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86fc63-6459-4776-b961-4ee0980b4d5b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.239458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.240285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.240564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.240834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] PATH_INFO: `/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b/users/af39f9bee06a473187191c0e339d4531/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.243081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c093bd9b254311a8ae94c2e8df5d2b, user_id=af39f9bee06a473187191c0e339d4531, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.246226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6566d-a3c5-42cf-be7d-ff7a5b1500b4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.253348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1268-8aed-44b0-8562-86d7cc7cb2fa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.267254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1011/2023] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:45 2022] PUT /identity/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b/users/af39f9bee06a473187191c0e339d4531/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:45.274200 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.275223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.276412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.344869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] MFA Rules not processed for user `af39f9bee06a473187191c0e339d4531`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:45.347068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.377995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.378968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.378968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.379311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] PATH_INFO: `/v3/projects/48e20559e586479c8a898c7108507e31` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.380456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e20559e586479c8a898c7108507e31)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.382624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.436771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1012/2024] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:45.437451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.438903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.449348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e20559e586479c8a898c7108507e31', 'request_id': 'req-8e62dc80-5d03-4cb3-a6d2-882729e50b79'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.458588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e20559e586479c8a898c7108507e31', 'request_id': 'req-8e62dc80-5d03-4cb3-a6d2-882729e50b79'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.471818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e20559e586479c8a898c7108507e31', 'request_id': 'req-8e62dc80-5d03-4cb3-a6d2-882729e50b79'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.484869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] The token cache is being invalidate because project 48e20559e586479c8a898c7108507e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:45.485180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.485869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.486136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:45.487814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1013/2025] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:45 2022] DELETE /identity/v3/projects/48e20559e586479c8a898c7108507e31 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:45.488821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.490248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.496324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:45.516330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe91980-2e82-424e-b808-86b2ed128a7b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.561321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dc80-5d03-4cb3-a6d2-882729e50b79 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.565654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.566279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.566553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.566817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.569081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.577164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.577887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.578160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.578439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.580645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.638400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.639835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.650349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1014/2026] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:45.650630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.651180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.652100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.652662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.663391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1013/2027] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:45.701733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:45.713579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e0ed-318c-4005-a314-2890f0b6ca81 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.718015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.718717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.718922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.719213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.722148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:45.744741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364046-7055-45b0-8ed9-a6840e0e48d1 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:45.750325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:45.750984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:45.751351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:45.751652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] PATH_INFO: `/v3/users/8ae454ab12e34e089d5879d891974ccf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:45.753034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae454ab12e34e089d5879d891974ccf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.755173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.799227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:45.800915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:45.812510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1014/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:45.820425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae454ab12e34e089d5879d891974ccf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.821378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae454ab12e34e089d5879d891974ccf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.822013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae454ab12e34e089d5879d891974ccf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.828227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:45.836896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae454ab12e34e089d5879d891974ccf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.846082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1c1e3e0-42fc-4737-8a32-d94493095a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae454ab12e34e089d5879d891974ccf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:45.869788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1015/2029] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:45 2022] DELETE /identity/v3/users/8ae454ab12e34e089d5879d891974ccf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:46.513318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:46.525791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9f0b5-1c84-4642-97ed-44329ce0db4c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:46.596670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:46.644046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:46.645158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:46.645158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:46.645367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] PATH_INFO: `/v3/projects/95d7f13dcf8348c7a7372435da84dbac` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:46.646613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d7f13dcf8348c7a7372435da84dbac)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:46.649166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:46.741655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d7f13dcf8348c7a7372435da84dbac', 'request_id': 'req-59696ede-1ac3-4e90-8e1e-7cc444af43a7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:46.750154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d7f13dcf8348c7a7372435da84dbac', 'request_id': 'req-59696ede-1ac3-4e90-8e1e-7cc444af43a7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:46.767975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d7f13dcf8348c7a7372435da84dbac', 'request_id': 'req-59696ede-1ac3-4e90-8e1e-7cc444af43a7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:46.781500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] The token cache is being invalidate because project 95d7f13dcf8348c7a7372435da84dbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:46.781798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:46.782609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59696ede-1ac3-4e90-8e1e-7cc444af43a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:46.784557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1015/2030] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:46 2022] DELETE /identity/v3/projects/95d7f13dcf8348c7a7372435da84dbac => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:46.794088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:46.794872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:46.795235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:46.825071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:46.827038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:46.916023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1016/2031] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:46.925844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:46.926172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:46.926489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:46.949941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:46.950723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:46.959621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1016/2032] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:46.964027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:46.978488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5473-07ed-455e-8d43-8a6e30fa1487 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:46.984248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:46.984979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:46.985259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:46.985566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:46.986441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:46.986766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:46.988566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.017097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1017/2033] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:47.018315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.028728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74c351-159b-4e35-977f-fcb4ace00e04 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.034911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.035766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.036040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.036310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.036963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.038906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.072365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1017/2034] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:47.077975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.091814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c603c-5123-4f90-bd37-cee536efef68 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.186426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.187457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.187735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.188004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.188669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.190803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.220590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1018/2035] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:47 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:47.222613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.239496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73849-4575-494d-9f01-a739f6a2bb9a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.246739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.247511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.247849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.248155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.248858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.250535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.289371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1018/2036] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:47.296172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.312091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc49b-9ab4-4bec-9d64-b0d458b0241d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.324555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.325382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.325737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.326043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.326763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.328665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaac520-4948-496a-b0e6-23a294e79126 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.343858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1019/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:47.351298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.377723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe5a7-e389-4b09-af9c-df29355ee2a7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.383763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.384470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.384747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.385057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] PATH_INFO: `/v3/projects/c7ee2c17cddb40de81971749ed0feb86/users/c53596cea46d4d728e30cede86b3dbba/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.408131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ee2c17cddb40de81971749ed0feb86, user_id=c53596cea46d4d728e30cede86b3dbba, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.418379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.453036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1019/2038] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:47 2022] PUT /identity/v3/projects/c7ee2c17cddb40de81971749ed0feb86/users/c53596cea46d4d728e30cede86b3dbba/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:47.466788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.467575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.467854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.536735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] MFA Rules not processed for user `c53596cea46d4d728e30cede86b3dbba`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:47.553158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:47.621223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:47.718038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1020/2039] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:47.724214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:47.927951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642cfe8-ac64-41cd-bf4a-1b7cde83418f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:47.947227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:47.948074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:47.948497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:47.948796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:47.949969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:47.953757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:47.967409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:48.011382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1020/2040] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:47 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:48.016056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.032368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4405c-5b98-4da6-a6de-b6334012d991 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.127323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.128028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.128309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.128583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.129383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.133773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.174267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1021/2041] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:48 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:48.178878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.195821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644372b-63c5-4ca1-b4c5-c57e52988119 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.211359 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.212675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.213341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.213878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.214725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.216964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.236730 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1021/2042] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:48.238714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.252878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f1fd9-318a-4e3f-97e9-3912959ea53f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.258985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.260041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.260762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.261210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] PATH_INFO: `/v3/projects/0878307952b840e3bb8af8135e34eac0/users/89910bc87c674573a874f0a3c44f540b/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.290226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0878307952b840e3bb8af8135e34eac0, user_id=89910bc87c674573a874f0a3c44f540b, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.293524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.333399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1022/2043] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:48 2022] PUT /identity/v3/projects/0878307952b840e3bb8af8135e34eac0/users/89910bc87c674573a874f0a3c44f540b/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:48.338336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.351939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99f0a5-c4ea-42dc-b458-286df2937217 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.473571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.474212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.474582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.474881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.475562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.478399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac03c-9a77-46a6-8591-c71b5365f205 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.498531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1022/2044] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:48.498883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.512329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009374-b213-4417-88c0-e47566011fa0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.519104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.520168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.520530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.520812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] PATH_INFO: `/v3/projects/0878307952b840e3bb8af8135e34eac0/users/89910bc87c674573a874f0a3c44f540b/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.523484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0878307952b840e3bb8af8135e34eac0, user_id=89910bc87c674573a874f0a3c44f540b, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.528895 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.556563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1023/2045] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:48 2022] PUT /identity/v3/projects/0878307952b840e3bb8af8135e34eac0/users/89910bc87c674573a874f0a3c44f540b/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:48.568822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.569257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.569523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.610676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] MFA Rules not processed for user `89910bc87c674573a874f0a3c44f540b`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:48.611999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:48.709413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1023/2046] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:48.754688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:48.756628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:48.823916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815eecd-64b3-44b7-a8c4-14027c272e8f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:48.829268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:48.829940 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:48.830212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:48.830481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:48.841341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:48.843036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:48.870337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1024/2047] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:49.015088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:49.017407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:49.033146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56498b6-9132-492b-be38-e21e1fbad1d5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:49.046963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:49.047684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:49.048028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:49.048329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:49.112980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:49.115565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:49.117542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8e38b-6791-4f3c-ac4f-c3f2e6a93e06 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:49.128509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1024/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:49.536728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:49.538981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:49.570583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:49.615232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97dad-c0c6-44b0-b516-2689f8d8fe7b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:49.620057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:49.620776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:49.621094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:49.621572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] PATH_INFO: `/v3/users/20281e13fd854c5d93f5ad567b96e95a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:49.622811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20281e13fd854c5d93f5ad567b96e95a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:49.624816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:49.679945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20281e13fd854c5d93f5ad567b96e95a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:49.680691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20281e13fd854c5d93f5ad567b96e95a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:49.681302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20281e13fd854c5d93f5ad567b96e95a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:49.697394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20281e13fd854c5d93f5ad567b96e95a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:49.706998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20281e13fd854c5d93f5ad567b96e95a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:49.724676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1025/2049] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:49 2022] DELETE /identity/v3/users/20281e13fd854c5d93f5ad567b96e95a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:49.729966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:49.730295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:49.730664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:49.750606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:49.751789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:49.813709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1025/2050] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:49.823573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:49.826024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:49.892392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96c6d-8310-437a-8608-fb23f67e8bb6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:49.897654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:49.898289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:49.898602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:49.898873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:49.909747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:49.911241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:49.921343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1026/2051] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:50.361839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:50.363751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:50.379019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2644f7-3e5a-4b71-bf5b-f8febc529898 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:50.384862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:50.385684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:50.386313 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:50.386729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] PATH_INFO: `/v3/projects/ac90b02a61d8443786d69b1b3f435a04` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:50.388274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac90b02a61d8443786d69b1b3f435a04)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:50.390473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:50.459749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac90b02a61d8443786d69b1b3f435a04', 'request_id': 'req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.466639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac90b02a61d8443786d69b1b3f435a04', 'request_id': 'req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.475662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac90b02a61d8443786d69b1b3f435a04', 'request_id': 'req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.487105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] The token cache is being invalidate because project ac90b02a61d8443786d69b1b3f435a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:50.487475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.488094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.489943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1026/2052] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:50 2022] DELETE /identity/v3/projects/ac90b02a61d8443786d69b1b3f435a04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:50.494211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:50.507014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb84377-0bb6-4def-9595-a7a2143e29e1 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:50.558206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:50.580325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:50.581206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:50.581504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:50.582172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] PATH_INFO: `/v3/users/fc57fbc5e0dd4dfaa9a22db8c1b18f83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:50.583743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc57fbc5e0dd4dfaa9a22db8c1b18f83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:50.585958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:50.659472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc57fbc5e0dd4dfaa9a22db8c1b18f83'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.660607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc57fbc5e0dd4dfaa9a22db8c1b18f83'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.661247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc57fbc5e0dd4dfaa9a22db8c1b18f83'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.678551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc57fbc5e0dd4dfaa9a22db8c1b18f83'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.686919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc57fbc5e0dd4dfaa9a22db8c1b18f83'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:50.706487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1027/2053] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:50 2022] DELETE /identity/v3/users/fc57fbc5e0dd4dfaa9a22db8c1b18f83 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:51.028919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.030813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.044109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec982f-c9de-4c87-8a8d-8c62a7e2cfb5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.120976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.122115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.122539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.122951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] PATH_INFO: `/v3/projects/dd67f41604204ac78d7a4dbfad04967e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.124779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd67f41604204ac78d7a4dbfad04967e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.128125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:51.157402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:51.194079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd67f41604204ac78d7a4dbfad04967e', 'request_id': 'req-266bbe07-a6e1-4605-a459-170ccd6fc640'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.199820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.201355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.203231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd67f41604204ac78d7a4dbfad04967e', 'request_id': 'req-266bbe07-a6e1-4605-a459-170ccd6fc640'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.215342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0d41-a37a-44d9-b35f-94cbf04fbcf3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.216083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd67f41604204ac78d7a4dbfad04967e', 'request_id': 'req-266bbe07-a6e1-4605-a459-170ccd6fc640'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.234409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] The token cache is being invalidate because project dd67f41604204ac78d7a4dbfad04967e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:51.234871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.235880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.241638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1027/2054] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:51 2022] DELETE /identity/v3/projects/dd67f41604204ac78d7a4dbfad04967e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:51.242968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.245312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.314483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.316170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.317044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.318213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] PATH_INFO: `/v3/users/776192c3157c4d23b12f0a491ef12f36` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.321661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776192c3157c4d23b12f0a491ef12f36)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.329678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:51.332460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bbe07-a6e1-4605-a459-170ccd6fc640 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.341092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.355456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.355456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.355456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] PATH_INFO: `/v3/users/af39f9bee06a473187191c0e339d4531` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.355456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af39f9bee06a473187191c0e339d4531)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.355456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:51.421800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af39f9bee06a473187191c0e339d4531'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.421800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af39f9bee06a473187191c0e339d4531'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.421800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af39f9bee06a473187191c0e339d4531'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.442268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af39f9bee06a473187191c0e339d4531'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.450214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776192c3157c4d23b12f0a491ef12f36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.453118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776192c3157c4d23b12f0a491ef12f36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.455182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776192c3157c4d23b12f0a491ef12f36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.464505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-29129f13-5d5d-4b8f-8974-3a23787b1b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af39f9bee06a473187191c0e339d4531'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.477008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776192c3157c4d23b12f0a491ef12f36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.478423 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:51.489188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776192c3157c4d23b12f0a491ef12f36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:51.494284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1028/2055] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:51 2022] DELETE /identity/v3/users/af39f9bee06a473187191c0e339d4531 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:51.523897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1028/2056] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:51 2022] DELETE /identity/v3/users/776192c3157c4d23b12f0a491ef12f36 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:51.528647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.528784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.529037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.569157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:51.570399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.620076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:51.677775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1029/2057] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:51.688846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.692489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.769578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6f4a6-17d4-4db7-b923-ff688c0f2642 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.773396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.774192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.774492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.774736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.784697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.786129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:51.796433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1029/2058] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:51.879982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.881478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.895031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bdb88-03c5-40e2-904a-84066833e602 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.902748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:51.903665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.904477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.906377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.906377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] PATH_INFO: `/v3/users/c53596cea46d4d728e30cede86b3dbba` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.906632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:51.906805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53596cea46d4d728e30cede86b3dbba)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.909470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:51.949241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333efe7-81f9-462d-b392-a40be8070016 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:51.958865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:51.960311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:51.961089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:51.961522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] PATH_INFO: `/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:51.963049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c093bd9b254311a8ae94c2e8df5d2b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:51.966323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.021665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53596cea46d4d728e30cede86b3dbba'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.023662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53596cea46d4d728e30cede86b3dbba'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.024491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53596cea46d4d728e30cede86b3dbba'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.039246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53596cea46d4d728e30cede86b3dbba'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.061809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b5cc6df-2cf1-47ab-8705-ab6fb9852faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53596cea46d4d728e30cede86b3dbba'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.069126 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c093bd9b254311a8ae94c2e8df5d2b', 'request_id': 'req-3fde3144-42bd-4250-b292-a67916302f76'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.078910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c093bd9b254311a8ae94c2e8df5d2b', 'request_id': 'req-3fde3144-42bd-4250-b292-a67916302f76'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.090174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c093bd9b254311a8ae94c2e8df5d2b', 'request_id': 'req-3fde3144-42bd-4250-b292-a67916302f76'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.100818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1030/2059] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:51 2022] DELETE /identity/v3/users/c53596cea46d4d728e30cede86b3dbba => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:52.107289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.108114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.109697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.113760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] The token cache is being invalidate because project a4c093bd9b254311a8ae94c2e8df5d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:52.114150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.114858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3fde3144-42bd-4250-b292-a67916302f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.117219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1030/2060] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:51 2022] DELETE /identity/v3/projects/a4c093bd9b254311a8ae94c2e8df5d2b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:52.123242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a34a-c889-429c-8bf1-e4e79f52a943 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.123677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a34a-c889-429c-8bf1-e4e79f52a943 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.124056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a34a-c889-429c-8bf1-e4e79f52a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.151968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2397a34a-c889-429c-8bf1-e4e79f52a943 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:52.153467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2397a34a-c889-429c-8bf1-e4e79f52a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.161128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:52.162499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.253190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1031/2061] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:52.259374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1031/2062] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:52.264070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.265610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.267607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.268000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.268339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.293252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:52.294779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.307314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1032/2063] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:52.307314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.307314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.314907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:52.323903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faea7ef-7cc4-4edb-9a55-c5292df945d1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.325093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:52.334265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.334924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.335220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.335744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] PATH_INFO: `/v3/projects/82b3b4ba263c43e39514b5e52592aea0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.336813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b3b4ba263c43e39514b5e52592aea0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.339039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.341847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7038de-a207-4fb7-a0a2-10f738432a4d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.346054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.346728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.347006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.347407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.357502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.358986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.369492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1032/2064] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:52.377878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.400985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b3b4ba263c43e39514b5e52592aea0', 'request_id': 'req-a977e0c1-8431-413e-8d1c-4b8b108f7268'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.401459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eecf-3707-4fcd-8962-a71c9455581e service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.408721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b3b4ba263c43e39514b5e52592aea0', 'request_id': 'req-a977e0c1-8431-413e-8d1c-4b8b108f7268'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.419728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b3b4ba263c43e39514b5e52592aea0', 'request_id': 'req-a977e0c1-8431-413e-8d1c-4b8b108f7268'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.435766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] The token cache is being invalidate because project 82b3b4ba263c43e39514b5e52592aea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:52.437027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.438059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.441457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1033/2065] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:52 2022] DELETE /identity/v3/projects/82b3b4ba263c43e39514b5e52592aea0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:52.445291 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.446810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.485418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.487037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.487580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.488005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.488965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:52.489417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.491715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.515557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1033/2066] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:52.524542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.526573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.546859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6d5f-0c36-4535-9a93-55f5878e8aaf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.552166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977e0c1-8431-413e-8d1c-4b8b108f7268 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.557505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.557900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.558567 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.558848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.559122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] PATH_INFO: `/v3/users/1d2e10aac2d54fbdb424b5b3936a011c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.562092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2e10aac2d54fbdb424b5b3936a011c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.563432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.563834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.564165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.564868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.567621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.570482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.607066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1034/2067] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:52 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:52.608149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.659654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2e10aac2d54fbdb424b5b3936a011c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.660952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2e10aac2d54fbdb424b5b3936a011c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.663716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2e10aac2d54fbdb424b5b3936a011c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.693662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2e10aac2d54fbdb424b5b3936a011c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.707948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2e10aac2d54fbdb424b5b3936a011c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:52.734686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1034/2068] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:52 2022] DELETE /identity/v3/users/1d2e10aac2d54fbdb424b5b3936a011c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:52.740398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc30a1-24b8-4644-a7ce-a5fd9e4f76b9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:52.855743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.858454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.876542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:52.920830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:52.921606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:52.921997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:52.923053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:52.923857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:52.926388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:52.939589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:52.975014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1035/2069] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:52 2022] POST /identity/v3/users => generated 281 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:52.979107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:52.989089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:52.998047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b671af-d429-4981-9230-9a8d1e81c1f9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.002794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd02-50cf-4528-b05a-f9440d29c0e2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.005558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.007042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.007431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.007833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] PATH_INFO: `/v3/projects/c7ee2c17cddb40de81971749ed0feb86` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.008231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.008916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.009400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.009671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.010087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ee2c17cddb40de81971749ed0feb86)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.010510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.012258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.016529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.024624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1036/2070] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:34:53.029455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.050516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8843de-be37-48d8-8b82-a873caa4e3d5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.064963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.065646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.065930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.066204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.066859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.068995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.082510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1037/2071] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:53.086749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.112424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974988-7b5f-43ef-8822-16a22da85e81 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.114777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ee2c17cddb40de81971749ed0feb86', 'request_id': 'req-0995e9e2-e019-4860-8d19-e321cc40a7a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.124730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ee2c17cddb40de81971749ed0feb86', 'request_id': 'req-0995e9e2-e019-4860-8d19-e321cc40a7a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.138329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ee2c17cddb40de81971749ed0feb86', 'request_id': 'req-0995e9e2-e019-4860-8d19-e321cc40a7a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.154054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] The token cache is being invalidate because project c7ee2c17cddb40de81971749ed0feb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:53.154601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.155476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.157377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1035/2072] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:52 2022] DELETE /identity/v3/projects/c7ee2c17cddb40de81971749ed0feb86 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:53.162419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.166048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.224099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.225607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.225866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.226204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] PATH_INFO: `/v3/projects/46bc4d5207dd493baa1ac23742f6aa3c/users/67b126fe01294e6ead7ca62e85fd76da/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.271779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bc4d5207dd493baa1ac23742f6aa3c, user_id=67b126fe01294e6ead7ca62e85fd76da, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.279816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.304757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995e9e2-e019-4860-8d19-e321cc40a7a6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.316819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1038/2073] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:53 2022] PUT /identity/v3/projects/46bc4d5207dd493baa1ac23742f6aa3c/users/67b126fe01294e6ead7ca62e85fd76da/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:53.317951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.320368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.362986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:53.392018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.392536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.392914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.393285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] PATH_INFO: `/v3/users/89910bc87c674573a874f0a3c44f540b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.396332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89910bc87c674573a874f0a3c44f540b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.399831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.421927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368758-a2d8-4ae0-8001-37c32391ddba admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.436317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.436464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.436746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.437050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] PATH_INFO: `/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.440039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7b4ceb0bc34b5c95be5e2061349a57)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.445583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.458479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89910bc87c674573a874f0a3c44f540b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.459265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89910bc87c674573a874f0a3c44f540b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.459970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89910bc87c674573a874f0a3c44f540b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.476781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89910bc87c674573a874f0a3c44f540b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.486306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6403ec28-b93e-453c-a50f-d96d5ea4a70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89910bc87c674573a874f0a3c44f540b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.506815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1036/2074] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:53 2022] DELETE /identity/v3/users/89910bc87c674573a874f0a3c44f540b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:53.508436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.508723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.508996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.524636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7b4ceb0bc34b5c95be5e2061349a57', 'request_id': 'req-ad27810b-4876-44d1-b1a3-bc4820b51b3e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.532917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7b4ceb0bc34b5c95be5e2061349a57', 'request_id': 'req-ad27810b-4876-44d1-b1a3-bc4820b51b3e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.537429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:53.540514 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] MFA Rules not processed for user `67b126fe01294e6ead7ca62e85fd76da`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:53.541823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.547464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7b4ceb0bc34b5c95be5e2061349a57', 'request_id': 'req-ad27810b-4876-44d1-b1a3-bc4820b51b3e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.573636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] The token cache is being invalidate because project 4e7b4ceb0bc34b5c95be5e2061349a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:53.574130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.575775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad27810b-4876-44d1-b1a3-bc4820b51b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:53.579001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1039/2075] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:53 2022] DELETE /identity/v3/projects/4e7b4ceb0bc34b5c95be5e2061349a57 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:53.586587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1b0-4e14-449f-8ada-c7c4c62a2e13 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.587125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1b0-4e14-449f-8ada-c7c4c62a2e13 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.587657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec1b0-4e14-449f-8ada-c7c4c62a2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.622144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4a0ec1b0-4e14-449f-8ada-c7c4c62a2e13 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:53.623551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4a0ec1b0-4e14-449f-8ada-c7c4c62a2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.683968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1037/2076] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:53.721347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.724154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.746738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1040/2077] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:53.756176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.756455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.756732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.786592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:53.791518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.815050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1041/2078] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:53.819262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.829548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44645-1122-4482-b9a8-36ee4882df94 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.830824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872cdf-622e-4148-b59c-5b6294bb5ffa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.833887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.834523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.835656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.836080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.840731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.841838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.841838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.842044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.842785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:53.843325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:53.843633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.845464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.847578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.850840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.863986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1038/2079] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:34:53.864209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1042/2080] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:53.868914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.880351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:53.885022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:53.901612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfab73-1841-43d4-bc39-e429236ed0a6 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.907778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.908511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.908877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.909317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.910080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.912861 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.928594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a3b1-087b-44c9-8614-28c5104c3ba0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:53.934579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:53.939005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:53.939320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:53.939598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] PATH_INFO: `/v3/users/67b126fe01294e6ead7ca62e85fd76da` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:53.941728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b126fe01294e6ead7ca62e85fd76da)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:53.943704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:53.955776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1039/2081] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:53 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:53.956827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.041235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8fea-5ca9-47c4-83c6-670fbd641ca7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.046558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.047185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.047326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b126fe01294e6ead7ca62e85fd76da'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.047519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.047756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.048039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b126fe01294e6ead7ca62e85fd76da'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.048751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.048957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b126fe01294e6ead7ca62e85fd76da'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.051018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.058470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b126fe01294e6ead7ca62e85fd76da'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.075535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9aaedbb6-e6c6-46b8-9504-a70349964e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b126fe01294e6ead7ca62e85fd76da'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.092607 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1040/2082] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:53 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:54.097633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.102235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.109566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1043/2083] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:53 2022] DELETE /identity/v3/users/67b126fe01294e6ead7ca62e85fd76da => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:54.114687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.115164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.115522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.124832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71657-44f7-4df8-ab15-3469fad02790 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.178813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:54.183297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.197177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.197817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.198093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.198364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.199081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.201336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.213962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1041/2084] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:54.218592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.231718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eee3f-d2fd-4e3a-b201-32eb0d9f443f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.250537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.251175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.251773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.251773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.253182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.255233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.283660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:54.286183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1042/2085] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:54.287385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.292463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.307604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59776c2-343c-40d2-bce9-e0a7d144d7b4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.315811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.316468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.316757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.317021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] PATH_INFO: `/v3/projects/0878307952b840e3bb8af8135e34eac0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.319569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0878307952b840e3bb8af8135e34eac0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.321302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.332805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1044/2086] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:54.333769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.345378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7248ff-4298-4738-b8b2-1d80292234b9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.350449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.350913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.351224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.351500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] PATH_INFO: `/v3/projects/f47a74860f2e4fc882672af296a84be3/users/425007b3ad62464db0983f7bba53f46b/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.376476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47a74860f2e4fc882672af296a84be3, user_id=425007b3ad62464db0983f7bba53f46b, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.376942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.384020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:54.394917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0878307952b840e3bb8af8135e34eac0', 'request_id': 'req-82c387b5-7b6d-492d-b3f7-5e971decd56e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.398645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1045/2087] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:54 2022] PUT /identity/v3/projects/f47a74860f2e4fc882672af296a84be3/users/425007b3ad62464db0983f7bba53f46b/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:54.398645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.408013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0878307952b840e3bb8af8135e34eac0', 'request_id': 'req-82c387b5-7b6d-492d-b3f7-5e971decd56e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.409568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.419761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0878307952b840e3bb8af8135e34eac0', 'request_id': 'req-82c387b5-7b6d-492d-b3f7-5e971decd56e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.444488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] The token cache is being invalidate because project 0878307952b840e3bb8af8135e34eac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:54.444488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.445782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.447619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1043/2088] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:54 2022] DELETE /identity/v3/projects/0878307952b840e3bb8af8135e34eac0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:54.451761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.453269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.485222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ce0c-484f-4327-b060-c5f205a67793 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.489796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.490438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.490719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.490993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.492985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.527941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c387b5-7b6d-492d-b3f7-5e971decd56e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:54.581870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.583496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392f29-63a9-4646-9254-ca5803d25a07 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.595758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1046/2089] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:54.597422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40e162-9140-4008-bc62-881c9bf3a219 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.597764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40e162-9140-4008-bc62-881c9bf3a219 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.598035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40e162-9140-4008-bc62-881c9bf3a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.606791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:54.608930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.609377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.609984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] PATH_INFO: `/v3/users/4833d27a22cb49d192e0b29d809d7936` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.611498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4833d27a22cb49d192e0b29d809d7936)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:54.614686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:54.636825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2e40e162-9140-4008-bc62-881c9bf3a219 None None] MFA Rules not processed for user `425007b3ad62464db0983f7bba53f46b`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:54.638447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2e40e162-9140-4008-bc62-881c9bf3a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.694457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4833d27a22cb49d192e0b29d809d7936'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.695179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4833d27a22cb49d192e0b29d809d7936'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.696636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4833d27a22cb49d192e0b29d809d7936'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.731536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4833d27a22cb49d192e0b29d809d7936'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.748935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96a5e1aa-4fdd-4843-adf9-7f149dccd254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4833d27a22cb49d192e0b29d809d7936'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:54.755232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:54.755466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:54.772516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1044/2090] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:54 2022] DELETE /identity/v3/users/4833d27a22cb49d192e0b29d809d7936 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:54.773780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1047/2091] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:54.773780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4717d4-698e-4942-b80c-8c29dbe135ad None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.773780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4717d4-698e-4942-b80c-8c29dbe135ad None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.773780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4717d4-698e-4942-b80c-8c29dbe135ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.787938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.788330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.790229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.803225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2e4717d4-698e-4942-b80c-8c29dbe135ad None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:54.804905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2e4717d4-698e-4942-b80c-8c29dbe135ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.817535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:54.818853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.917142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1045/2092] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:54.918102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:54.918329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1048/2093] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:54.930901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.931891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:54.932674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:54.932674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:54.974647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:54.975922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:54.999215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1049/2094] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:55.000168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.003366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.052007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4519d6-5fee-4713-90da-b89d52794b3b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.056243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.056882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.057156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.057487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.096123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdc3d6-1b52-4a17-947e-f69617987b10 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.100189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.100963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.101311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.101652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.113682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.115465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.126509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1050/2095] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:55.135071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.138633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.140246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.142504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.154999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1046/2096] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:55.154999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.161833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ddd94-c3c6-46b2-94af-825a45da5b66 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.168859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.169579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.169854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.170323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] PATH_INFO: `/v3/projects/46bc4d5207dd493baa1ac23742f6aa3c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.172377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bc4d5207dd493baa1ac23742f6aa3c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.187091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610060-cdd0-412c-90a1-9c5cbfeafe35 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.187277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.192639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.193378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.194137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.194558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.195377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:55.195788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.198379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.220619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1047/2097] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:55.221637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.224968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.246346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082a766-1b9b-4c38-b995-951588613f02 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.247282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bc4d5207dd493baa1ac23742f6aa3c', 'request_id': 'req-910217bc-1d4b-4f85-a9ac-af01803fbba6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.262186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bc4d5207dd493baa1ac23742f6aa3c', 'request_id': 'req-910217bc-1d4b-4f85-a9ac-af01803fbba6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.276947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bc4d5207dd493baa1ac23742f6aa3c', 'request_id': 'req-910217bc-1d4b-4f85-a9ac-af01803fbba6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.295935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] The token cache is being invalidate because project 46bc4d5207dd493baa1ac23742f6aa3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:55.296621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.297812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.299312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:55.301208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1051/2098] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:55 2022] DELETE /identity/v3/projects/46bc4d5207dd493baa1ac23742f6aa3c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:55.305723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.308000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.348660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:55.361394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.363152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.363910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.364473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] PATH_INFO: `/v3/users/425007b3ad62464db0983f7bba53f46b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.366047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425007b3ad62464db0983f7bba53f46b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.368477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.413652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910217bc-1d4b-4f85-a9ac-af01803fbba6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.425962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.425962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.425962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.425962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.426408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.426408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429340-dfa3-4c7c-b9a7-c7a3c97a3433 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.465235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425007b3ad62464db0983f7bba53f46b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.466199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425007b3ad62464db0983f7bba53f46b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.467080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425007b3ad62464db0983f7bba53f46b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.468193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1052/2099] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:55 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:55.470357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3427-939f-44c0-997c-ec3524836c99 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.470745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3427-939f-44c0-997c-ec3524836c99 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.471649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3427-939f-44c0-997c-ec3524836c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.484946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425007b3ad62464db0983f7bba53f46b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.492995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-209a3427-939f-44c0-997c-ec3524836c99 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:55.494617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-209a3427-939f-44c0-997c-ec3524836c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.495010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425007b3ad62464db0983f7bba53f46b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.515409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1048/2100] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:55 2022] DELETE /identity/v3/users/425007b3ad62464db0983f7bba53f46b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:55.516273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.518715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.585329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1053/2101] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:55.587322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462378f1-d957-4f04-bc13-b7715b81c58d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.587954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462378f1-d957-4f04-bc13-b7715b81c58d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.588455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462378f1-d957-4f04-bc13-b7715b81c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.610763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-462378f1-d957-4f04-bc13-b7715b81c58d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:55.611737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-462378f1-d957-4f04-bc13-b7715b81c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.640159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d22a26-c43b-4c00-9fb3-dd3ee10ad444 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.644926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.645551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.645833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.646101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.646749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.648856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.688040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1049/2102] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:55 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:55.692137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.693977 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.705465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1054/2103] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:55.707139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.707585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.707861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.712770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d662-9950-477d-bf97-c0f81d4a087b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.722431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.723743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.724170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.724752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] PATH_INFO: `/v3/projects/399620b7df6c4dff9701ef2bae08cf20` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.726300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399620b7df6c4dff9701ef2bae08cf20)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.729147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.730824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:55.732201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.740531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1055/2104] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:55.741269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.752399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2fc11-8f8b-400f-ab32-4233d5e184d1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.758297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.759841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.760118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.760391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.761601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:55.763290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:55.787990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1056/2105] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:55.787990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.788702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.832621 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:55.834948 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:55.844855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399620b7df6c4dff9701ef2bae08cf20', 'request_id': 'req-25d2746f-4d05-4d73-bd9a-7de2a8acb301'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.857827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399620b7df6c4dff9701ef2bae08cf20', 'request_id': 'req-25d2746f-4d05-4d73-bd9a-7de2a8acb301'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.871668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399620b7df6c4dff9701ef2bae08cf20', 'request_id': 'req-25d2746f-4d05-4d73-bd9a-7de2a8acb301'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.885536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9014d-c483-4e88-9bdc-5d17c62d1df5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:55.886734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] The token cache is being invalidate because project 399620b7df6c4dff9701ef2bae08cf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:55.887172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.888064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:55.890145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1050/2106] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:55 2022] DELETE /identity/v3/projects/399620b7df6c4dff9701ef2bae08cf20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:55.891827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:55.893864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:55.951031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:55.951929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:55.952228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:55.952515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:55.954705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.049907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.051657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.060828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2746f-4d05-4d73-bd9a-7de2a8acb301 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.063843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1057/2107] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:56.064991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.070560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.071416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.071703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.072024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.072763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:56.073067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.074778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.077926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.088716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1051/2108] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:56.093158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.094992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.110401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30a66-501f-4e6c-8e03-0cb60c324f73 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.117150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.118332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.118717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.119118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] PATH_INFO: `/v3/users/8cc1dd3e415646e2bde21f7982c2e2c5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.120807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc1dd3e415646e2bde21f7982c2e2c5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.123237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.124888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14479c8-1b1e-4749-9699-976e82c36e4d service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.142794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.145147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.145622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.145900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.148020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.150454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.194516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1058/2109] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:56.195560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.208982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e9d3-4137-4215-9307-9c379e82faf5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.214210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.214843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.215123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.215541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.217090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.218236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.258788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc1dd3e415646e2bde21f7982c2e2c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:56.260804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc1dd3e415646e2bde21f7982c2e2c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:56.261666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc1dd3e415646e2bde21f7982c2e2c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:56.274261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1059/2110] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:56 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:56.276156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.280933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.298982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc1dd3e415646e2bde21f7982c2e2c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:56.316299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc1dd3e415646e2bde21f7982c2e2c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:56.355305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1052/2111] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:56 2022] DELETE /identity/v3/users/8cc1dd3e415646e2bde21f7982c2e2c5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:56.358190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.369185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.441662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:56.453380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928db2c-331b-4945-929d-d318052cb352 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.470171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:56.570314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a8bc-355e-478b-8eff-afb9309349c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.586691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.587394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.588081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.588368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.590424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.592512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.594377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.594907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.595445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.595821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] PATH_INFO: `/v3/projects/27a36d8c1c9347bcac291644e6761d27/users/92263320bcef41c2b40f28dd5ee36f71/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.631088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a36d8c1c9347bcac291644e6761d27, user_id=92263320bcef41c2b40f28dd5ee36f71, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.636505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce36d4-32de-458c-af5b-c0be5af47488 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.644398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1053/2112] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:56 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:56.650263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.681805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1060/2113] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:56 2022] PUT /identity/v3/projects/27a36d8c1c9347bcac291644e6761d27/users/92263320bcef41c2b40f28dd5ee36f71/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:56.683967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.684386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.684637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908a07e-97cd-450b-a294-2c4daa51fcee admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.685347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.759340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] MFA Rules not processed for user `92263320bcef41c2b40f28dd5ee36f71`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:56.762028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:56.787118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.788018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.788609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.789053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.790168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.792071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.827506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1054/2114] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:56.831900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.864261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b01ef-6967-4c36-b5e7-38c244009027 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.885404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.886551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.886551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.886983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.894063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:56.899628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:56.928386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1055/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:56.928386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:56.952279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2025-54f5-4f5f-adb3-58b22d2c9b61 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:56.968675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:56.971055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:56.973002 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:56.973363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] PATH_INFO: `/v3/projects/23895be4c5f04ce3a60384a9e8fc88d1/users/49ad21565f9340deaf381edf90026afd/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:56.982763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1061/2116] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:56.983907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.006278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3165f-6d58-4a32-837f-261f982ceae2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.007628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23895be4c5f04ce3a60384a9e8fc88d1, user_id=49ad21565f9340deaf381edf90026afd, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.010845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b6f0d-a07b-4bf6-b4b9-bf9f173edb9f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.017907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.018689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.018906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.019159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.019848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.021949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.054389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1056/2117] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:56 2022] PUT /identity/v3/projects/23895be4c5f04ce3a60384a9e8fc88d1/users/49ad21565f9340deaf381edf90026afd/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:34:57.059238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.059680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.060368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.122302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1062/2118] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:56 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:34:57.123248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.126831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] MFA Rules not processed for user `49ad21565f9340deaf381edf90026afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:57.127902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.130961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.241861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:57.275150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032085c-bc75-4c80-83ee-fec780ebb609 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.283841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.284579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.285040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.285242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1057/2119] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:34:57.285366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] PATH_INFO: `/v3/projects/f47a74860f2e4fc882672af296a84be3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.286709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.286824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47a74860f2e4fc882672af296a84be3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.289707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.301742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d419-112f-4810-b428-e1a4985e548a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.309256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.310608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.311071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.311555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.312412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.315791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.336738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:57.345137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1058/2120] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:57.349098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.352928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.355275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47a74860f2e4fc882672af296a84be3', 'request_id': 'req-f9f3a3e8-745d-409e-ac39-417bc08c90d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.363492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47a74860f2e4fc882672af296a84be3', 'request_id': 'req-f9f3a3e8-745d-409e-ac39-417bc08c90d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.375268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47a74860f2e4fc882672af296a84be3', 'request_id': 'req-f9f3a3e8-745d-409e-ac39-417bc08c90d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.390974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] The token cache is being invalidate because project f47a74860f2e4fc882672af296a84be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:57.391461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.392190 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.394231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1063/2121] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:57 2022] DELETE /identity/v3/projects/f47a74860f2e4fc882672af296a84be3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:57.395001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.396665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.427138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03310f-2f7b-4034-935b-9c2e2cbffc9d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.484930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3a3e8-745d-409e-ac39-417bc08c90d4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.490294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.491020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.492436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.493057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.493330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.493594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.493876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.494294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.495052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.496597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.496898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741296b-9be1-4272-be85-860ddcf1217f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.513012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1064/2122] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:57.514691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.515061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.515424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.561922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:57.565577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.581028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1065/2123] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:57.582906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.584595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252d92a-e55b-4bb9-832b-8615d41ff599 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.588354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.599484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1059/2124] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:57.602986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.602986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.602986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.623466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f12f-8f58-4453-ad33-840f1c0e2358 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.625245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:57.626730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.631882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.633613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.634839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.635529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] PATH_INFO: `/v3/projects/26a90a82921247c9a7f5a105525d6b07/users/0c8b6e87e79948978d97b2aa666fae42/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.638206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1060/2125] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:57.639461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.641463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.656554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea67-ced4-4619-a7d4-23822ed7cf3d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.662755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.664221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.664601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.664968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] PATH_INFO: `/v3/projects/37edabc6752c4bafa5980e4bb89650cc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.667224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37edabc6752c4bafa5980e4bb89650cc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.668867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.672764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a90a82921247c9a7f5a105525d6b07, user_id=0c8b6e87e79948978d97b2aa666fae42, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.676850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.714982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1066/2126] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:57 2022] PUT /identity/v3/projects/26a90a82921247c9a7f5a105525d6b07/users/0c8b6e87e79948978d97b2aa666fae42/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:57.716331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.762703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37edabc6752c4bafa5980e4bb89650cc', 'request_id': 'req-88560ca9-8335-4735-9027-3518aea6c323'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.781569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37edabc6752c4bafa5980e4bb89650cc', 'request_id': 'req-88560ca9-8335-4735-9027-3518aea6c323'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.787302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:57.800636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37edabc6752c4bafa5980e4bb89650cc', 'request_id': 'req-88560ca9-8335-4735-9027-3518aea6c323'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.822586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] The token cache is being invalidate because project 37edabc6752c4bafa5980e4bb89650cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:34:57.823178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.824376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:57.824962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:57.827660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1061/2127] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:34:57 2022] DELETE /identity/v3/projects/37edabc6752c4bafa5980e4bb89650cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:57.835026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.837437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:57.865035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4722-f8ef-41bc-bb92-047e095809fb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.952992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.954109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.954990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.955419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.956293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:57.956658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560ca9-8335-4735-9027-3518aea6c323 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:57.957155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.958863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421911-e366-42d5-a4f1-38e159817f02 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.963133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:57.964062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.967704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.968223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.969124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:57.970943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:57.978211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1067/2128] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:57.979718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:57.980329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:57.980670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:57.993143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1062/2129] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:57.993830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:57.996495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:58.018965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb5ada-7650-4089-b6ca-165661c16842 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.024427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.025073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.025352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.025627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.027224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.032003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53528ce-afc8-4550-aa9b-ba1f14abbe21 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.032155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:58.032686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:58.070402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1068/2130] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:58.071470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.081083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1063/2131] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:57 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:58.085709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594130c9-a1d8-48ba-83a8-689ded63ebd3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.086224 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594130c9-a1d8-48ba-83a8-689ded63ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.086751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594130c9-a1d8-48ba-83a8-689ded63ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.108734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f22a0-af36-4050-b920-10594c42c5ab None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.149172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-594130c9-a1d8-48ba-83a8-689ded63ebd3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:58.156384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-594130c9-a1d8-48ba-83a8-689ded63ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:58.227921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.228645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.228918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.229188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] PATH_INFO: `/v3/projects/26a90a82921247c9a7f5a105525d6b07/users/0c8b6e87e79948978d97b2aa666fae42/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.233391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a90a82921247c9a7f5a105525d6b07, user_id=0c8b6e87e79948978d97b2aa666fae42, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.236769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.283907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1069/2132] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:58 2022] PUT /identity/v3/projects/26a90a82921247c9a7f5a105525d6b07/users/0c8b6e87e79948978d97b2aa666fae42/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:58.286840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.324308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1064/2133] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:58.324308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.324308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.324308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.365986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] MFA Rules not processed for user `0c8b6e87e79948978d97b2aa666fae42`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:58.367494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:58.375480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d398c9-9ba4-4739-ae1a-1ff7b9752382 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.388301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.389158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.389444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.389944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.390736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.393489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.427039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1070/2134] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:58.427039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.428288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:58.439328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50579b28-73f0-4fbc-ae39-484394ba115d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.445119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.445666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.445946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.446245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.446903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:34:58.447652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.449192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.451764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:58.453973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1065/2135] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:58.454946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.469179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7ea6-9240-4f57-af4a-196552a26b21 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.473130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1071/2136] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:34:58.474141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.474815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.475568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.475929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.476448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.477264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.477419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:58.478863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.501120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1066/2137] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:58.501120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.513485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe258b-cd81-48ee-b375-410e085b0c03 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.519323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.520004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.520352 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.520782 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.521730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.524570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.564732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1067/2138] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:58.566262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.579997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e7a9d-9a1a-451e-87d9-ac16da94bf78 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.667560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cedf0c-5059-4b31-96be-3a4000f22cd1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.677905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.679450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.679879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.680315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.680991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.684658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.685460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.687860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.691510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.693522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.725385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1068/2139] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:58.726440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.768965 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d989-cead-4a8f-92a5-064c350ed428 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.772708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.774734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.782104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.783118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.783647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.784706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.787663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.789994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.797390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1072/2140] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:58.798407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.825623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184667fc-95fd-4a8a-aafb-25f0eaa9cbe8 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.835377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.836089 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.836370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.836647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] PATH_INFO: `/v3/projects/115ecb87027843e287a65872b9cfdf44/users/97ce0e9cd4154698b4cca77ff88df79c/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.845510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1069/2141] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/users => generated 281 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:58.858188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.876404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=115ecb87027843e287a65872b9cfdf44, user_id=97ce0e9cd4154698b4cca77ff88df79c, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.878746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e29f8-c990-479f-a773-796b06b7933a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:58.882371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.894489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:58.895746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.898583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.900676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:58.902099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:58.904559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f070b-e038-4d6b-9f05-0e3de1fe3aee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:58.934948 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1073/2142] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:58 2022] PUT /identity/v3/projects/115ecb87027843e287a65872b9cfdf44/users/97ce0e9cd4154698b4cca77ff88df79c/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:58.936208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:58.949113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1070/2143] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:58.953122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:58.953122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:58.953122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.010512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.021311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] MFA Rules not processed for user `97ce0e9cd4154698b4cca77ff88df79c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:59.022670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.042236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411a8f4-5166-4072-8e0e-8b52c1f7d16d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.046923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.047589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.047871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.048169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.054009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.140569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1071/2144] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:59.140569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.156915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.164907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.167318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.189663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1074/2145] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:59.190657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.192157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.206193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a370a8-c006-4fb8-844f-46cd055dd60e service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.210276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.210908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.211215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.211498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.216685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.279173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616b336-e096-4353-8284-99bdf41fa992 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.285545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.286892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.286892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.286892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.287392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.289885 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.305437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1072/2146] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:34:59.306443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.320602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f3c47-b14c-4a85-8702-d271248633f9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.330312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.331298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.331677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.332087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.332939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.337894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.348568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.350557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.376469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1075/2147] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:34:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:34:59.378205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.387780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1073/2148] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:59 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:59.388862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.393173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.401519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780f3a-e635-4938-8eca-ca46a7cfe0f9 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.495408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.496013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.496287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.496712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] PATH_INFO: `/v3/projects/1dd806304b934768811cde552bf7259b/users/56b2b736e4ea4d439cde7f325b6aed30/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.498667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdb5a6-2102-4bfd-9a2e-abb63a95ed39 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.507712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.509278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.509648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.509934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] PATH_INFO: `/v3/users/9a1411b0bd2449708c5be668586b777c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.511574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1411b0bd2449708c5be668586b777c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.513660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.519158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd806304b934768811cde552bf7259b, user_id=56b2b736e4ea4d439cde7f325b6aed30, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.522733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.548503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1076/2149] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:34:59 2022] PUT /identity/v3/projects/1dd806304b934768811cde552bf7259b/users/56b2b736e4ea4d439cde7f325b6aed30/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:59.560735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.582543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.613930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1411b0bd2449708c5be668586b777c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:59.616022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1411b0bd2449708c5be668586b777c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:59.617722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1411b0bd2449708c5be668586b777c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:59.645392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1411b0bd2449708c5be668586b777c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:59.656070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89ac0b73-3db7-4003-95db-30cc4a61a234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1411b0bd2449708c5be668586b777c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:34:59.689268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324de5-960a-4bd4-bc5f-61e647b781ab admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:34:59.694979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:34:59.695826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.696211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.696530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.697168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:34:59.699392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcdaa9-c523-428c-94a9-aea1876f6097 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:34:59.707746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1074/2150] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:34:59 2022] DELETE /identity/v3/users/9a1411b0bd2449708c5be668586b777c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:34:59.722257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.722746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.729244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.737802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1077/2151] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:34:59 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:34:59.743035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:34:59.743615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:34:59.744003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:34:59.753044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:34:59.793956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] MFA Rules not processed for user `49ad21565f9340deaf381edf90026afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:59.797080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.834830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] MFA Rules not processed for user `56b2b736e4ea4d439cde7f325b6aed30`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:34:59.836174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.920984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1078/2152] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:59.921930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.923800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:34:59.948339 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1075/2153] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:34:59.953394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:34:59.955048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.093227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c89fc-59ae-43f1-a44e-82e7716c8db5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.098542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.099919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.100308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.100690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.101835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.103739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedaf3b-8c53-43f6-9a0a-64468539c3ac None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.104056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.108993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.109640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.109923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.110201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.111155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.113408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.130969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1079/2154] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:00.130969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.130969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.146203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea2ae4-84d4-4900-a3a7-50939902c155 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.147426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1076/2155] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:34:59 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:00.148507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.187154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:00.215957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.216806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.217183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.217556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] PATH_INFO: `/v3/projects/c830c4f3b75e43b9bc4d4095444b0838` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.218836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c830c4f3b75e43b9bc4d4095444b0838)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.221640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.224678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdc4bc-9e03-493a-9a75-112a312a9023 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.230380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.231178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.231668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.231956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.232730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.234451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.245387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1077/2156] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:00.246391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.257714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962acbb9-5e74-4c7b-8047-d9ed81293749 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.263625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.264467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.264856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.265210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.265998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.268283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.282026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:00.284934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c830c4f3b75e43b9bc4d4095444b0838', 'request_id': 'req-d2df0b3b-a981-4640-a9f5-b6b237a12646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:00.293309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c830c4f3b75e43b9bc4d4095444b0838', 'request_id': 'req-d2df0b3b-a981-4640-a9f5-b6b237a12646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:00.304764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1078/2157] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:00 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:00.305570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.308015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c830c4f3b75e43b9bc4d4095444b0838', 'request_id': 'req-d2df0b3b-a981-4640-a9f5-b6b237a12646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:00.321158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826f452-35cc-4460-8eac-995c3d799f83 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.328039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] The token cache is being invalidate because project c830c4f3b75e43b9bc4d4095444b0838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:00.328443 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:00.329722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:00.332954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1080/2158] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:00 2022] DELETE /identity/v3/projects/c830c4f3b75e43b9bc4d4095444b0838 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:00.334601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.336997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.396712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.397924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.398266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.398582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] PATH_INFO: `/v3/projects/f9ac1b3e9adb4be1a0d5b5a340686fde/users/d4a4c83051dd4ba5ba7e086969c74b23/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.427269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ac1b3e9adb4be1a0d5b5a340686fde, user_id=d4a4c83051dd4ba5ba7e086969c74b23, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.427269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73406e2-f090-4db0-bc3a-e33f8edac899 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.456021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0b3b-a981-4640-a9f5-b6b237a12646 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.458243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1079/2159] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:00 2022] PUT /identity/v3/projects/f9ac1b3e9adb4be1a0d5b5a340686fde/users/d4a4c83051dd4ba5ba7e086969c74b23/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:00.460321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.460614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.461042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.485503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:00.486756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.527636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.528751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.529210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.529641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.530469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.532479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2683-426e-4aef-9ec4-bad975f4d35e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.558884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1081/2160] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:00.558884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.559680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.560739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.582655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1080/2161] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:00.583432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.599823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1e679-e8fe-4507-9c26-c04f05b26a84 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.612859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.613690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.614061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.614447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] PATH_INFO: `/v3/projects/aa63b14ae50a42c7a5802c5191038e70/users/d3a98c7ff38742238f2b648384e33127/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.617469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:00.632196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] MFA Rules not processed for user `d4a4c83051dd4ba5ba7e086969c74b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:00.634479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.662698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa63b14ae50a42c7a5802c5191038e70, user_id=d3a98c7ff38742238f2b648384e33127, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.666790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c540cf-b7ac-4395-b3b8-cfca4347934d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.702874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1081/2162] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:00 2022] PUT /identity/v3/projects/aa63b14ae50a42c7a5802c5191038e70/users/d3a98c7ff38742238f2b648384e33127/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:00.704952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.705584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.705956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.739635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:00.741005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.781279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1082/2163] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:00.781279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.799404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce0a1-2299-48fb-b877-2ecb3f010366 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.806688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:00.823720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1082/2164] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:00.824605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.826273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:00.872087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e7537-014a-4f18-b33f-e49e817ea3f9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.886575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.887249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.887534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.887809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.888462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.892400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.915575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.916268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.917833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.918113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.918812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:00.920491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:00.948011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1083/2165] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:00.950294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.967448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d340f-4f55-4bac-8fb4-b406142ebabd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:00.979832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1083/2166] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:00.981221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:00.992335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:00.992559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:00.993843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:00.994131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:00.994820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:00.995293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.003639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.048837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1084/2167] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:01.052755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.078841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223330-90a0-4e76-b0d8-4d192ff7ac7f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.199970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.200655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.201170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.201488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.202636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc2b1-ad80-479c-a2c4-91aa0b2936fe admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.203157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.206725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.221489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.222256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.223016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.223383 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] PATH_INFO: `/v3/projects/aa63b14ae50a42c7a5802c5191038e70/users/d3a98c7ff38742238f2b648384e33127/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.226121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa63b14ae50a42c7a5802c5191038e70, user_id=d3a98c7ff38742238f2b648384e33127, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.229537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.248970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1084/2168] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:00 2022] PUT /identity/v3/projects/aa63b14ae50a42c7a5802c5191038e70/users/d3a98c7ff38742238f2b648384e33127/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:01.248970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.249315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1085/2169] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:01.249315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.276219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed400b9-64e4-4736-97a9-b6ecdb7fd537 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.291394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:01.355738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3f1a-d4fd-456e-9dde-5f5b5f5857e1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.365038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.366085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.366233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.366408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.366801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.366899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.367137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.367678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.367764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.368484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.369737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12ee6-84be-40d5-b68b-df021ae27aae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.371388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.381740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1086/2170] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:35:01.383100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.383418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.383692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.419274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] MFA Rules not processed for user `d3a98c7ff38742238f2b648384e33127`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:01.419274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:01.437643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1085/2171] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:01.437643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.518234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:01.533861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1087/2172] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:01.538450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11047e50-fbf7-4fd5-bf53-eaf16b5b0ed9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.538582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.547141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.547909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.548210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.548593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] PATH_INFO: `/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007/users/999f01e55a0d48dfa2dbd596a732fe8c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.552041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78235d-2cc7-4b70-b49c-ae89b283a609 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.556765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.557398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.557679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.558095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.558735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.561907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.569755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc89e0b72064a5688a9ad21d4f4b007, user_id=999f01e55a0d48dfa2dbd596a732fe8c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.572541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.585816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1088/2173] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:01.587251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1086/2174] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:01 2022] PUT /identity/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007/users/999f01e55a0d48dfa2dbd596a732fe8c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:01.587483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.589344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:01.596396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.657675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7fcef-2aba-49d6-a457-78431ff5b922 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.678284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a994670-98eb-47e6-9553-4b289f0cd12c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.683491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.684131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.684414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.684689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.685722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.687403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.691430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:01.698623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1087/2175] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:35:01.699755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.710935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac3176-c50d-4edb-a5f5-9447a00ee90c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.715794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.716434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.716715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.716994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.717708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.719396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.719837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.720819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.721233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.721707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.731473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1088/2176] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:01.731473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.745957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce998080-935a-4393-bd1d-d5156a9346aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.751500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.752138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.752447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.752682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.753450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.755110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.767256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1089/2177] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:01.768038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.778956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90128-26ed-4b07-ac08-033dfd3dcc67 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.784075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.784816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.785096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.785367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] PATH_INFO: `/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007/users/999f01e55a0d48dfa2dbd596a732fe8c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.787474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc89e0b72064a5688a9ad21d4f4b007, user_id=999f01e55a0d48dfa2dbd596a732fe8c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.790180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.802453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1090/2178] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:01 2022] PUT /identity/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007/users/999f01e55a0d48dfa2dbd596a732fe8c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:01.803335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.826073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.827588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602d970-1f1a-4f4d-bc77-c2af1dca00ad service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.846312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1089/2179] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:01.849039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296dc4-4c90-4c7d-9b14-e61f78115295 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.849415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296dc4-4c90-4c7d-9b14-e61f78115295 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.849859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296dc4-4c90-4c7d-9b14-e61f78115295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.897442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-34296dc4-4c90-4c7d-9b14-e61f78115295 None None] MFA Rules not processed for user `999f01e55a0d48dfa2dbd596a732fe8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:01.899783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-34296dc4-4c90-4c7d-9b14-e61f78115295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:01.902202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f67e6-58dd-455a-9604-59ee645c50cb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:01.907327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:01.908025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.908303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.908577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] PATH_INFO: `/v3/projects/077f5f00167e4a68a1afa2d4e43f1c65/users/525edac979aa45e3adb880f99dfb3345/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:01.937574 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077f5f00167e4a68a1afa2d4e43f1c65, user_id=525edac979aa45e3adb880f99dfb3345, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:01.940486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:01.956675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1091/2180] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:01 2022] PUT /identity/v3/projects/077f5f00167e4a68a1afa2d4e43f1c65/users/525edac979aa45e3adb880f99dfb3345/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:01.957595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:01.985221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1090/2181] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:01.986878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:01.987607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:01.988754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:02.004564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:02.009412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:02.010734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:02.046975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e9ce-c57d-4774-b948-823495054f25 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:02.050722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:02.051402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:02.051684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:02.051958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:02.053871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:02.093908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1091/2182] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:02.095040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:02.096970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:02.110774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fd60f-fa80-4118-8bb2-f8fa2729322c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:02.116659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:02.117294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:02.117591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:02.117920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:02.120437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:02.129719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:02.134757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:02.136244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:02.148576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1092/2183] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:02.149469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:02.151120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:02.277314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:02.280108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:02.301345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a0c9d-4b92-43bc-8723-98e8d428a69b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:02.315467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:02.316368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1092/2184] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:02.327590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:02.329393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:02.329795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:02.368572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:02.369342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:02.393074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1093/2185] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:04.381193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:04.391082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22891e8b-a931-4c9b-8956-254747536aec service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:04.395569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:04.396382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:04.396713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:04.396908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:04.475451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:04.477495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:04.502413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1093/2186] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:05.864595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:05.876407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07937d8-85ac-436d-b688-30ff73177549 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:05.891812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:05.892465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:05.892821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:05.893254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:06.043993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:06.046290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8612037-4135-4dda-96f0-5b56e1727f50 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:06.063496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1094/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:06.495549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:06.498112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:06.517356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106bbb-3429-463d-b44b-c535f2ed446f service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:06.523343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:06.525196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:06.525621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:06.526078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] PATH_INFO: `/v3/users/92263320bcef41c2b40f28dd5ee36f71` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:06.527557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92263320bcef41c2b40f28dd5ee36f71)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:06.529799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:06.638769 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92263320bcef41c2b40f28dd5ee36f71'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:06.639558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92263320bcef41c2b40f28dd5ee36f71'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:06.640232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92263320bcef41c2b40f28dd5ee36f71'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:06.653195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92263320bcef41c2b40f28dd5ee36f71'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:06.679544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92263320bcef41c2b40f28dd5ee36f71'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:06.709097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1094/2188] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:06 2022] DELETE /identity/v3/users/92263320bcef41c2b40f28dd5ee36f71 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:06.713594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:06.714066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:06.714490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:06.770909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:06.773241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:06.784581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:06.911351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1095/2189] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:06.929419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:06.931138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:06.987615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:07.093586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f1b2-12b2-4cd5-8214-1c8411740246 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:07.097568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:07.102425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:07.102720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:07.102994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:07.139129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:07.141048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:07.172360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1095/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:08.637670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:08.639180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:08.657093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54ee0-018c-4bd7-a0b5-21149c91e0a7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:08.666750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:08.667624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:08.667998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:08.668271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] PATH_INFO: `/v3/projects/27a36d8c1c9347bcac291644e6761d27` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:08.669892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a36d8c1c9347bcac291644e6761d27)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:08.672180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:08.757771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a36d8c1c9347bcac291644e6761d27', 'request_id': 'req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:08.766292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a36d8c1c9347bcac291644e6761d27', 'request_id': 'req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:08.776968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a36d8c1c9347bcac291644e6761d27', 'request_id': 'req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:08.796660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] The token cache is being invalidate because project 27a36d8c1c9347bcac291644e6761d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:08.797026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:08.797879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:08.804111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1096/2191] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:08 2022] DELETE /identity/v3/projects/27a36d8c1c9347bcac291644e6761d27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:08.805262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:08.817403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79808a-cde4-41b4-a67b-1c5a08422f7a service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:08.926366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:08.927581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:08.928088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:08.928512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] PATH_INFO: `/v3/users/0c8b6e87e79948978d97b2aa666fae42` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:08.932269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8b6e87e79948978d97b2aa666fae42)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:08.934988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:09.011109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8b6e87e79948978d97b2aa666fae42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.011991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8b6e87e79948978d97b2aa666fae42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.012895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8b6e87e79948978d97b2aa666fae42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.020750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8b6e87e79948978d97b2aa666fae42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.043724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5068b9e4-f7a6-49e4-af75-d78f9988909c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8b6e87e79948978d97b2aa666fae42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.074801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1096/2192] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:08 2022] DELETE /identity/v3/users/0c8b6e87e79948978d97b2aa666fae42 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:09.551837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:09.553755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:09.583292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726df4e-8b6f-45a8-94bd-35e49ed2a7f1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:09.791719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:09.796376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:09.797277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:09.798483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] PATH_INFO: `/v3/projects/26a90a82921247c9a7f5a105525d6b07` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:09.802271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a90a82921247c9a7f5a105525d6b07)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:09.813530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:09.910160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:09.930950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a90a82921247c9a7f5a105525d6b07', 'request_id': 'req-93ce8246-1dba-4392-bfbc-95de622b90bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.947561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a90a82921247c9a7f5a105525d6b07', 'request_id': 'req-93ce8246-1dba-4392-bfbc-95de622b90bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.967745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a90a82921247c9a7f5a105525d6b07', 'request_id': 'req-93ce8246-1dba-4392-bfbc-95de622b90bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.989705 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] The token cache is being invalidate because project 26a90a82921247c9a7f5a105525d6b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:09.990038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:09.999827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93ce8246-1dba-4392-bfbc-95de622b90bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:10.009365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1097/2193] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:09 2022] DELETE /identity/v3/projects/26a90a82921247c9a7f5a105525d6b07 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:10.021200 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.021765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.021765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.076085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:10.077338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:10.169682 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:10.207858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1097/2194] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:10.217353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.217773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.218149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.269128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:10.271906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:10.293051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1098/2195] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:10.299708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.313258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632572d-8211-4247-81a9-883c220bc3bd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.335151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.336023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.336308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.336589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.337800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:10.338703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.340781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.376399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1098/2196] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:10.381144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.392436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922bfc2-6674-4ac8-bbd7-0a73feabe17d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.398039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.399501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.399852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.400122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.400865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.403478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.462787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1099/2197] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:10 2022] POST /identity/v3/projects => generated 399 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:10.468309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.484604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a51da-68df-4507-aeef-a2b520f47f9a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.571658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.572829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.573269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.573844 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.574659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.576848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.613565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1099/2198] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:10 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:10.614835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.629466 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eec33-7783-43cb-b01c-206e87534a26 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.634618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.637320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.637618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.637890 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.638564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.640408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.654139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1100/2199] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:10.658701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.674637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38717f18-bc11-41f7-8e2a-096c611481ea admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.689241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.689989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.690414 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.690788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.691595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.696335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.713479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1100/2200] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:10.714390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.726104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eed6-14de-4da9-a031-796bc45d3ac5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.735406 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.736553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.736996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.737593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] PATH_INFO: `/v3/projects/5ace6883f4314db591c78f378cb8197e/users/3b97b39fff2d41f49dd111bb738aad9f/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.761808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ace6883f4314db591c78f378cb8197e, user_id=3b97b39fff2d41f49dd111bb738aad9f, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.768335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.770477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:10.771587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf53a6-788e-47cd-acfe-992bb36b36b0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.789045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288b3a4-0156-4382-badc-42d0529c278a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:10.792643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1101/2201] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:10 2022] PUT /identity/v3/projects/5ace6883f4314db591c78f378cb8197e/users/3b97b39fff2d41f49dd111bb738aad9f/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:35:10.807308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.807761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.808330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.842475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] MFA Rules not processed for user `3b97b39fff2d41f49dd111bb738aad9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:10.844242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:10.919982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:10.920955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:10.921699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:10.923633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] PATH_INFO: `/v3/users/97ce0e9cd4154698b4cca77ff88df79c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:10.925824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ce0e9cd4154698b4cca77ff88df79c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:10.929205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:10.945241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1102/2202] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:10.958231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:10.960429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.013493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ce0e9cd4154698b4cca77ff88df79c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.014985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ce0e9cd4154698b4cca77ff88df79c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.020165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ce0e9cd4154698b4cca77ff88df79c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.022796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:11.036964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ce0e9cd4154698b4cca77ff88df79c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.051756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9a0d5ff1-b680-4761-af90-6c0206bce6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ce0e9cd4154698b4cca77ff88df79c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.068633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6aea2-fb42-419f-9eb3-9701d32fea75 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:11.071675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1101/2203] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:10 2022] DELETE /identity/v3/users/97ce0e9cd4154698b4cca77ff88df79c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:11.073404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:11.077286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.078397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.078768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.112259 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:11.113509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.156667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:11.157645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.158033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.158401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.160837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.248614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:11.249879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:11.267080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1103/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:35:11.312715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1102/2205] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:11.382251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:11.384629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.466241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:11.467912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.490594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116e79-9629-4d13-8bba-271eb57fbf2c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:11.503008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:11.506970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.507868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.508157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] PATH_INFO: `/v3/users/56b2b736e4ea4d439cde7f325b6aed30` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.512122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b2b736e4ea4d439cde7f325b6aed30)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:11.514116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:11.599183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e40b-689e-4a87-a6ec-07580ab0d4f3 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:11.616094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:11.618547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.619507 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.620012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.640620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b2b736e4ea4d439cde7f325b6aed30'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.641420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b2b736e4ea4d439cde7f325b6aed30'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.642144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b2b736e4ea4d439cde7f325b6aed30'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.651968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b2b736e4ea4d439cde7f325b6aed30'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.669992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:11.674517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e66-a573-4ee0-aee8-00516a657b50 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:11.701602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4d33940b-dd46-4821-b2e8-144212247175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b2b736e4ea4d439cde7f325b6aed30'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:11.713539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1104/2206] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:11.716116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.717038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.718972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.746059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1103/2207] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:11 2022] DELETE /identity/v3/users/56b2b736e4ea4d439cde7f325b6aed30 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:11.748768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:11.749790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:11.750252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:11.780354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:11.783956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.807598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] MFA Rules not processed for user `525edac979aa45e3adb880f99dfb3345`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:11.815559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.861713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:11.930705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1104/2208] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:11.944859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:11.947293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:11.975926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:12.003273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1105/2209] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:12.016536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:12.017739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:12.166268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461766f-d00f-4c20-b01d-1d46f5df6436 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:12.178647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:12.179639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:12.180162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:12.180681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:12.205266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:12.212395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:12.221111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7776e-9a76-4c9a-b0a9-8c594763b168 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:12.227455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:12.228115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:12.229061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:12.229838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:12.239164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:12.240839 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:12.245550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1105/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:12.263876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1106/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:35:12.544992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:12.546558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:12.566748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308416-da89-432b-aa17-14dd02745f1c service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:12.581244 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:12.582039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:12.582411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:12.582714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] PATH_INFO: `/v3/projects/115ecb87027843e287a65872b9cfdf44` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:12.585408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115ecb87027843e287a65872b9cfdf44)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:12.587841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:12.681967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115ecb87027843e287a65872b9cfdf44', 'request_id': 'req-9f8c608c-1f25-4b80-a1ad-ada94803c631'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:12.690499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115ecb87027843e287a65872b9cfdf44', 'request_id': 'req-9f8c608c-1f25-4b80-a1ad-ada94803c631'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:12.701530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115ecb87027843e287a65872b9cfdf44', 'request_id': 'req-9f8c608c-1f25-4b80-a1ad-ada94803c631'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:12.725358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] The token cache is being invalidate because project 115ecb87027843e287a65872b9cfdf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:12.726042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:12.728581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:12.732608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1106/2212] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:12 2022] DELETE /identity/v3/projects/115ecb87027843e287a65872b9cfdf44 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:12.736524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:12.750999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d3572-9512-4c50-8520-7f187ff72975 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:12.861011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:12.862831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:12.864009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:12.865200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:12.865674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:12.866245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] PATH_INFO: `/v3/users/d4a4c83051dd4ba5ba7e086969c74b23` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:12.886303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a4c83051dd4ba5ba7e086969c74b23)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:12.889634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:12.892144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c608c-1f25-4b80-a1ad-ada94803c631 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:12.902595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:12.904706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:12.905080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:12.905450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] PATH_INFO: `/v3/projects/1dd806304b934768811cde552bf7259b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:12.907336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd806304b934768811cde552bf7259b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:12.912392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:13.004697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd806304b934768811cde552bf7259b', 'request_id': 'req-d7910807-cfe0-437d-b2fe-c6399c2697f9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.006945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a4c83051dd4ba5ba7e086969c74b23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.009837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a4c83051dd4ba5ba7e086969c74b23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.010311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a4c83051dd4ba5ba7e086969c74b23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.017708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd806304b934768811cde552bf7259b', 'request_id': 'req-d7910807-cfe0-437d-b2fe-c6399c2697f9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.027708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:13.040600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd806304b934768811cde552bf7259b', 'request_id': 'req-d7910807-cfe0-437d-b2fe-c6399c2697f9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.047504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a4c83051dd4ba5ba7e086969c74b23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.060004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a4c83051dd4ba5ba7e086969c74b23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.063795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] The token cache is being invalidate because project 1dd806304b934768811cde552bf7259b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:13.064446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.066394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.069642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1107/2213] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:12 2022] DELETE /identity/v3/projects/1dd806304b934768811cde552bf7259b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:13.074676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:13.076974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:13.080378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:13.094200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1107/2214] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:12 2022] DELETE /identity/v3/users/d4a4c83051dd4ba5ba7e086969c74b23 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:13.213290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910807-cfe0-437d-b2fe-c6399c2697f9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:13.359835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:13.366557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:13.368360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:13.368646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] PATH_INFO: `/v3/users/d3a98c7ff38742238f2b648384e33127` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:13.370802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a98c7ff38742238f2b648384e33127)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:13.372534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:13.504198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a98c7ff38742238f2b648384e33127'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.505609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a98c7ff38742238f2b648384e33127'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.506560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a98c7ff38742238f2b648384e33127'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.517999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a98c7ff38742238f2b648384e33127'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.540219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a98c7ff38742238f2b648384e33127'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:13.570658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1108/2215] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:13 2022] DELETE /identity/v3/users/d3a98c7ff38742238f2b648384e33127 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:13.714711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:13.715798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:13.750468 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8660ba-51ae-4c4a-9501-e9bd2c604ece admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:13.929121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:13.930100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:13.930385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:13.930660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] PATH_INFO: `/v3/projects/f9ac1b3e9adb4be1a0d5b5a340686fde` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:13.932512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ac1b3e9adb4be1a0d5b5a340686fde)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:13.936880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:14.042110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ac1b3e9adb4be1a0d5b5a340686fde', 'request_id': 'req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.059855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ac1b3e9adb4be1a0d5b5a340686fde', 'request_id': 'req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.078662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ac1b3e9adb4be1a0d5b5a340686fde', 'request_id': 'req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.105160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] The token cache is being invalidate because project f9ac1b3e9adb4be1a0d5b5a340686fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:14.105160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.106816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.111360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1108/2216] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:13 2022] DELETE /identity/v3/projects/f9ac1b3e9adb4be1a0d5b5a340686fde => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:35:14.115968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:14.117457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:14.147013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc955e-f03c-4f3e-993c-97789468a515 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:14.173309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:14.184974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:14.187974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:14.324829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:14.325861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.327117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12be2-fcc3-4d77-a833-2d10a0301c1d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:14.327261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.327580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] PATH_INFO: `/v3/users/999f01e55a0d48dfa2dbd596a732fe8c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.330734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999f01e55a0d48dfa2dbd596a732fe8c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:14.333858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:14.341733 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:14.342455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.342735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.343014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] PATH_INFO: `/v3/projects/aa63b14ae50a42c7a5802c5191038e70` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.351109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa63b14ae50a42c7a5802c5191038e70)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:14.353113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:14.415872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:14.470501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999f01e55a0d48dfa2dbd596a732fe8c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.471910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999f01e55a0d48dfa2dbd596a732fe8c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.472921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999f01e55a0d48dfa2dbd596a732fe8c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.473171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa63b14ae50a42c7a5802c5191038e70', 'request_id': 'req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.483187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa63b14ae50a42c7a5802c5191038e70', 'request_id': 'req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.492806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999f01e55a0d48dfa2dbd596a732fe8c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.497713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa63b14ae50a42c7a5802c5191038e70', 'request_id': 'req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.514839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-09583c4e-8d4e-4790-a20f-961556ef6de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999f01e55a0d48dfa2dbd596a732fe8c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.547700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1109/2217] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:14 2022] DELETE /identity/v3/users/999f01e55a0d48dfa2dbd596a732fe8c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:14.552642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] The token cache is being invalidate because project aa63b14ae50a42c7a5802c5191038e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:14.552941 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.553676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8fdacd22-1a7a-43d0-bb22-2b90dda624b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:14.556032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1109/2218] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:14 2022] DELETE /identity/v3/projects/aa63b14ae50a42c7a5802c5191038e70 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:14.562079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.562653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.563470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.592873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:14.594433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:14.771581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1110/2219] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:14.774133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.774553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.774912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.821775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:14.824240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:14.860754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1110/2220] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:14.860960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:14.873864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc971f-c8c9-40ba-9150-e54a898b5442 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:14.888463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:14.889355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.889942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.890257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.893290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:14.893654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:14.898515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:14.926467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1111/2221] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:14.930648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:14.948297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628451f-fdcd-4b97-b294-dedf88ed6746 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:14.958653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:14.959726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:14.960917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:14.962652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:14.963432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:14.968029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5a845-9301-491a-8ae6-a85ea3da67ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.011242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1111/2222] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:14 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:35:15.015136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.030738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53fff-15af-4c9e-921c-8e412e18028a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.065096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:15.137668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.138905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.138905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.138905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.143918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.143918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.154649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.155635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.156115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.190629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] MFA Rules not processed for user `525edac979aa45e3adb880f99dfb3345`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:15.192545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.207996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1112/2223] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:15.214564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.230809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b91da-884f-4ce1-a189-c57c91143298 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.245501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.246424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.247047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.247047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.247630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.250094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.266650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1113/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:15.268285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.281527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.299744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5acb78-224e-465e-ac1f-110e57596d83 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.306874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.307697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.308187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.308533 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] PATH_INFO: `/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.310643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc89e0b72064a5688a9ad21d4f4b007)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.311162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1112/2225] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:15.312325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.319240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.349529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4ddf2-b6ba-4d17-a33a-c5da71805d96 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.362603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.363261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.363544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.363815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.364491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.370125 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.385590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1113/2226] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:15.391494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.405741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8493b-36a3-4a34-9cff-c39cddbb71eb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.438380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc89e0b72064a5688a9ad21d4f4b007', 'request_id': 'req-82f90ded-e280-492e-a3c8-de4d452ac58b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:15.452527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc89e0b72064a5688a9ad21d4f4b007', 'request_id': 'req-82f90ded-e280-492e-a3c8-de4d452ac58b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:15.468312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc89e0b72064a5688a9ad21d4f4b007', 'request_id': 'req-82f90ded-e280-492e-a3c8-de4d452ac58b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:15.488970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] The token cache is being invalidate because project 5dc89e0b72064a5688a9ad21d4f4b007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:15.489492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:15.490673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-82f90ded-e280-492e-a3c8-de4d452ac58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:15.493986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1114/2227] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:15 2022] DELETE /identity/v3/projects/5dc89e0b72064a5688a9ad21d4f4b007 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:15.501500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a176ef-e14b-419f-83a8-049fd8912ac0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.502031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a176ef-e14b-419f-83a8-049fd8912ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.502518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a176ef-e14b-419f-83a8-049fd8912ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.532565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-32a176ef-e14b-419f-83a8-049fd8912ac0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:15.534056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-32a176ef-e14b-419f-83a8-049fd8912ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.547515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.548593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.549025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.549440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] PATH_INFO: `/v3/projects/218564c53dd5465f97d6fe4d5d6f9a2d/users/9e83f52139394749a88f5c496dcf2b43/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.572213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218564c53dd5465f97d6fe4d5d6f9a2d, user_id=9e83f52139394749a88f5c496dcf2b43, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.575427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f6578-0166-4a7b-a631-8c9d9ad7f506 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.596501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1114/2228] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:15 2022] PUT /identity/v3/projects/218564c53dd5465f97d6fe4d5d6f9a2d/users/9e83f52139394749a88f5c496dcf2b43/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:15.609000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.609362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.609741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.625569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:15.632992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1115/2229] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:15.635963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca157-786c-488e-9693-73e4cf58295f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.636317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca157-786c-488e-9693-73e4cf58295f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.636683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca157-786c-488e-9693-73e4cf58295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.646654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] MFA Rules not processed for user `9e83f52139394749a88f5c496dcf2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:15.649551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.663950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-754ca157-786c-488e-9693-73e4cf58295f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:15.665292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-754ca157-786c-488e-9693-73e4cf58295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.688521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:15.736664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1115/2230] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:35:15.748033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.749886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:15.756658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1116/2231] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:15.761172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca157-786c-488e-9693-73e4cf58295f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.772262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca157-786c-488e-9693-73e4cf58295f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.785304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.785952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.786225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.786495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.787155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:15.787480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.789103 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.820187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1117/2232] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:35:15.824425 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.838777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293bc6-ac70-44ef-a658-012b9d663777 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.844597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.845377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.845652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.845921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.854903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f13151-dba0-4b60-9ba9-58cfb61568c2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:15.860021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.861294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.872878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1116/2233] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:35:15.876051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:15.876678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:15.876956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:15.877227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:15.877909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:15.879884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:15.935068 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1118/2234] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:15.938606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:15.955873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45c4e-f0e2-4a4c-9a00-bd522030979c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:16.087948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:16.088726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.089005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.089276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.090420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:16.098524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:16.180062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1117/2235] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:15 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:35:16.181085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:16.197911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484393a-158c-46b2-b530-1ae9c9e14a48 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:16.222872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:16.224156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.224573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.224933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.225937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:16.227775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:16.243308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1119/2236] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:16.247158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:16.263845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1f5c-4145-4bdd-8f00-cb26c25dd48d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:16.284971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:16.287881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.288164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.288790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.289485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:16.291157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5c435-d13b-4b69-8e33-ca0ed8ca3f0c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:16.319090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1118/2237] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:16.323927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:16.354451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc99a2-c3d5-4491-9bc0-292ecc67a614 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:16.364737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:16.367582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.368257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.368553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] PATH_INFO: `/v3/projects/4a296afc2b724913ae736795085d86a1/users/d40b81fc74cc4747bb71e9ec700fea3f/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.390230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a296afc2b724913ae736795085d86a1, user_id=d40b81fc74cc4747bb71e9ec700fea3f, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:16.393369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:16.446081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1120/2238] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:16 2022] PUT /identity/v3/projects/4a296afc2b724913ae736795085d86a1/users/d40b81fc74cc4747bb71e9ec700fea3f/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:16.450400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.450593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.450875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.516716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] MFA Rules not processed for user `d40b81fc74cc4747bb71e9ec700fea3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:16.532123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:16.542968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:16.746204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1119/2239] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:16.754843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:16.868292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eb775-9d9d-4ed9-b35a-fc53b1819d31 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:16.874050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:16.874946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:16.875380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:16.875646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:16.892169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:16.894088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840d03a-744a-4e59-9def-f5917c0ab676 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:16.906394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1121/2240] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:17.760418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:17.762399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:17.865764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005874-cd40-45c5-8233-ed3e1e999cea None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:17.873599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:17.874718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:17.875356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:17.875856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] PATH_INFO: `/v3/users/3b97b39fff2d41f49dd111bb738aad9f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:17.877773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b97b39fff2d41f49dd111bb738aad9f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:17.881721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:17.947661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b97b39fff2d41f49dd111bb738aad9f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:17.947661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b97b39fff2d41f49dd111bb738aad9f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:17.947661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b97b39fff2d41f49dd111bb738aad9f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:17.959877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b97b39fff2d41f49dd111bb738aad9f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:17.967547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b97b39fff2d41f49dd111bb738aad9f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:17.981922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1120/2241] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:17 2022] DELETE /identity/v3/users/3b97b39fff2d41f49dd111bb738aad9f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:17.987521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:17.988308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:17.988395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.017054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:18.017830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:18.086780 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:18.102676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1122/2242] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:35:18.114435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:18.116481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:18.158676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:18.198611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd10f99-b561-40e5-b3c0-c2555844c25a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:18.202899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:18.203464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:18.203822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:18.204232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.216255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:18.218052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd944-53e6-45e6-9ac4-89dd651f9694 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:18.229181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1121/2243] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:18.682049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:18.683576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:18.702604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897130f-4932-4dea-9372-55dd779e5a45 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:18.707628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:18.708350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:18.708591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:18.708895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] PATH_INFO: `/v3/projects/5ace6883f4314db591c78f378cb8197e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.710041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ace6883f4314db591c78f378cb8197e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:18.712012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:18.763010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ace6883f4314db591c78f378cb8197e', 'request_id': 'req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:18.771612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ace6883f4314db591c78f378cb8197e', 'request_id': 'req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:18.780552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ace6883f4314db591c78f378cb8197e', 'request_id': 'req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:18.791729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] The token cache is being invalidate because project 5ace6883f4314db591c78f378cb8197e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:18.792005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:18.792653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9fd43c4-f5ee-4d25-9d6c-10003ea0e6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:18.794294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1123/2244] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:18 2022] DELETE /identity/v3/projects/5ace6883f4314db591c78f378cb8197e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:18.799409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:18.800004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:18.800004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.822402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:18.823689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:18.894132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1122/2245] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:18.904039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:18.904482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:18.904944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.936166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:18.938396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:18.952271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1124/2246] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:18.956788 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:18.967504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92169-5d36-401d-afa5-bdd1e4fcdb48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:18.972228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:18.972840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:18.973115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:18.973384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:18.974039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:18.974344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:18.975971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:18.988160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1123/2247] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:18.992711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.003707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a71840-1ed4-4a79-8952-c1117e9eeeba None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.011355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.012347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.012789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.013229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.014301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.017724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.061182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1125/2248] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:18 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:19.063569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.074208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e184c-035d-4cda-bc5b-1b4298200fb6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.156873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.157502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.157798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.158041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.158677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.160764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.182960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1124/2249] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:19 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:19.187620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.198463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40349fd-af7b-4114-b939-acd673677d7e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.203028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.203665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.203985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.204255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.204908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.206563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.217138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1126/2250] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:19.221275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.231807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e76494-9cc4-478c-85b9-1aa3e201cca0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.237742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.238290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.238562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.238825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.239510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.241136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8ca7c-9abe-4cbe-be77-5b6c4743f7cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.252480 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1125/2251] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:35:19.257192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.267540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7227-e3e3-452b-82ef-ab56bc670521 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.273829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.274517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.274794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.275064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] PATH_INFO: `/v3/projects/c460e54b9c8e400f9b14942f3fc7d695/users/e774f9d4502845c8a8df321ced32b1f3/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.294680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c460e54b9c8e400f9b14942f3fc7d695, user_id=e774f9d4502845c8a8df321ced32b1f3, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.298885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.316503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1127/2252] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:19 2022] PUT /identity/v3/projects/c460e54b9c8e400f9b14942f3fc7d695/users/e774f9d4502845c8a8df321ced32b1f3/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:19.321827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.322110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.322428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.345156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:19.346378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.355542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.358315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.401411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:19.448251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d318688-3076-4acf-a5ad-c4c0046aac6d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.451483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1126/2253] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:35:19.455930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.456775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.457077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.457327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] PATH_INFO: `/v3/users/9e83f52139394749a88f5c496dcf2b43` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.458605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e83f52139394749a88f5c496dcf2b43)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.459767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.460676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.461409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.482668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:19.527451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e83f52139394749a88f5c496dcf2b43'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:19.529224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e83f52139394749a88f5c496dcf2b43'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:19.529924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e83f52139394749a88f5c496dcf2b43'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:19.535037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18f160-7260-421c-b9e3-de71352f1d51 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.540540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.541323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.541473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e83f52139394749a88f5c496dcf2b43'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:19.541925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.542331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.545058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.558254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6501b83f-82b8-4e7c-b0c3-36a19cffec05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e83f52139394749a88f5c496dcf2b43'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:19.581280 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1128/2254] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:19 2022] DELETE /identity/v3/users/9e83f52139394749a88f5c496dcf2b43 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:19.585669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.589119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.589405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.589680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.593533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.608798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1127/2255] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:19.616615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:19.618738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.728332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1129/2256] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:19.746324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:19.747754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:19.764577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f53c8-8139-4da2-bb9a-c192e83e60d3 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:19.861478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:19.862200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:19.862711 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:19.862851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:19.886229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:19.888124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cfd0e-4b92-4fcf-b874-b0db138a4c71 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:19.901461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1128/2257] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:20.369486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:20.371731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:20.404480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0052a9-2b43-4ae2-86fb-ffbb2ff18030 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:20.411635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:20.413148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.413578 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.414039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] PATH_INFO: `/v3/projects/218564c53dd5465f97d6fe4d5d6f9a2d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.415585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=218564c53dd5465f97d6fe4d5d6f9a2d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:20.417662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:20.509980 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218564c53dd5465f97d6fe4d5d6f9a2d', 'request_id': 'req-de9e0d48-c476-469b-85cb-1793312ba80d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:20.518294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218564c53dd5465f97d6fe4d5d6f9a2d', 'request_id': 'req-de9e0d48-c476-469b-85cb-1793312ba80d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:20.531630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218564c53dd5465f97d6fe4d5d6f9a2d', 'request_id': 'req-de9e0d48-c476-469b-85cb-1793312ba80d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:20.552138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] The token cache is being invalidate because project 218564c53dd5465f97d6fe4d5d6f9a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:20.552477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:20.553289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-de9e0d48-c476-469b-85cb-1793312ba80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:20.555221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1130/2258] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:20 2022] DELETE /identity/v3/projects/218564c53dd5465f97d6fe4d5d6f9a2d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:20.568453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.568767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.569082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.597984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:20.598153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:20.694377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1129/2259] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:20.703115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.703525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.703693 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.729920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:20.731622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:20.754475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1131/2260] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:20.756106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:20.768186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e18d2-8a28-40b4-8721-d5f630705c9e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:20.773597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:20.774284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.774678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.774984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.775870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:20.776179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:20.777881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:20.790754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1130/2261] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:35:20.795544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:20.805317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f351-9dfa-482a-81b4-b13128f02500 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:20.809991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:20.810957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.811255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.811530 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.812248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:20.814745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:20.825650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:20.854423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1132/2262] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:20 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:20.855631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:20.868287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a890a8-9aaf-4e6c-90b9-8d60a5c0615c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:20.876166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:20.972253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:20.974475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:20.975039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:20.975522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:20.976287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:20.978678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:21.017765 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:21.022401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1131/2263] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:20 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:35:21.037156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ac810-3716-4c4d-bebb-8852863f3031 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:21.054134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:21.055470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:21.055998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:21.056558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:21.058036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:21.060529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:21.090778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:21.101791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1133/2264] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:35:21.111668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f3d-c2f9-41b8-bcfa-218013367ce5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:21.131721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:21.132691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:21.133992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:21.134338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:21.135345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:21.138091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584a0c3-fb0c-447a-997a-58553a23a841 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:21.166471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:21.176319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1132/2265] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:21.182058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c90a8-ccbc-4f71-a742-c72e46e19ff8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:21.195375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:21.198038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:21.198559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:21.199879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] PATH_INFO: `/v3/projects/98be7cddeba64b568c8c2d603f43acc1/users/b6f176b6404d417a96681dd2ee77d095/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:21.286710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98be7cddeba64b568c8c2d603f43acc1, user_id=b6f176b6404d417a96681dd2ee77d095, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:21.296292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:21.336637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1134/2266] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:21 2022] PUT /identity/v3/projects/98be7cddeba64b568c8c2d603f43acc1/users/b6f176b6404d417a96681dd2ee77d095/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:21.348318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1dfb-4c33-407a-b133-874529c2ca84 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:21.348652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1dfb-4c33-407a-b133-874529c2ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:21.348946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de1dfb-4c33-407a-b133-874529c2ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:21.420306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-99de1dfb-4c33-407a-b133-874529c2ca84 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:21.421583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-99de1dfb-4c33-407a-b133-874529c2ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:21.561739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1133/2267] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:21.581236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:21.584203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:21.680270 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c0cb-3dde-4d95-af4a-4ece3259a15e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:21.686444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:21.688339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:21.688847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:21.689303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:21.729426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:21.731394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:21.759322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1135/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:23.814873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcab96-1da5-4177-abe7-271b728971d4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:23.815499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcab96-1da5-4177-abe7-271b728971d4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:23.815736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcab96-1da5-4177-abe7-271b728971d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:23.863300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8cbcab96-1da5-4177-abe7-271b728971d4 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:23.866428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8cbcab96-1da5-4177-abe7-271b728971d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:24.056725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1134/2269] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:35:24.146409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:24.147983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:24.353018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb352-f44a-4950-9baa-4c45301d3ce2 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:24.374805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:24.375499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:24.376025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:24.376337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:24.393161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768c30-dbf8-4e35-ba51-705f3237a654 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:24.393993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768c30-dbf8-4e35-ba51-705f3237a654 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:24.394473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768c30-dbf8-4e35-ba51-705f3237a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:24.401228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:24.403581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:24.420744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1136/2270] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:35:24.467849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f2768c30-dbf8-4e35-ba51-705f3237a654 None None] MFA Rules not processed for user `b6f176b6404d417a96681dd2ee77d095`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:24.469129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f2768c30-dbf8-4e35-ba51-705f3237a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:24.518269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:24.634325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1135/2271] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:24.650778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:24.653106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:24.771599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:24.779891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25487f-553f-4fff-805d-414ca98f0d24 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:24.788713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:24.791422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:24.791817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:24.793496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:24.816781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:24.821178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:24.845352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1137/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:25.640143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c943-bdaa-4f0d-ace3-f320774d342b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:25.640721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c943-bdaa-4f0d-ace3-f320774d342b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:25.640948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c943-bdaa-4f0d-ace3-f320774d342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:25.672240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ca27c943-bdaa-4f0d-ace3-f320774d342b None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:25.673812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca27c943-bdaa-4f0d-ace3-f320774d342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:25.684058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1136/2273] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:25.700400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:25.741052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bdb22-4cf2-4c83-a48f-32ad104840aa service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:25.747315 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:25.747957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:25.748240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:25.748514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:25.759057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:25.760899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:25.773182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1138/2274] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:35:26.162935 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfc0d-07c6-4baa-9ad2-cb13282caafe None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:26.163238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfc0d-07c6-4baa-9ad2-cb13282caafe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:26.163697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcfc0d-07c6-4baa-9ad2-cb13282caafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:26.188040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e8dcfc0d-07c6-4baa-9ad2-cb13282caafe None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:26.189482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e8dcfc0d-07c6-4baa-9ad2-cb13282caafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:26.197112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1137/2275] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:26.223052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:26.244920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b4fe-7ccd-47bc-a7cf-a39233c9de6a service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:26.254704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:26.255784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:26.256379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:26.256876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:26.287963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:26.294619 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd96c-bf4a-4ac4-bbe7-f4f5611b7c1d service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:26.312602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1139/2276] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:35:26.967149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:26.967732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:26.967732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:26.995686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:26.997943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:27.032979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1138/2277] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:27.043215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:27.043664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:27.043800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:27.050248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:27.076588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] MFA Rules not processed for user `b6f176b6404d417a96681dd2ee77d095`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:27.077998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c372e-67de-493a-9389-8b25ec47dc2e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:27.080936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:27.088785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:27.089435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:27.089713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:27.090084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:27.103995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1140/2278] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:27.114847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:27.118335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:27.153575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1139/2279] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:35:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:35:27.625027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:27.628782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:27.678655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa08d-e0f5-4e4a-9c2c-1bcf19b9657a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:27.696352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:27.697529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:27.697970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:27.698441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] PATH_INFO: `/v3/users/03066eef225f425e8bc9e05934f4f7dd` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:27.700118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03066eef225f425e8bc9e05934f4f7dd)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:27.709150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:27.808064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03066eef225f425e8bc9e05934f4f7dd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:27.808932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03066eef225f425e8bc9e05934f4f7dd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:27.809898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03066eef225f425e8bc9e05934f4f7dd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:27.825383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03066eef225f425e8bc9e05934f4f7dd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:27.846048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03066eef225f425e8bc9e05934f4f7dd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:27.875256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1141/2280] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:27 2022] DELETE /identity/v3/users/03066eef225f425e8bc9e05934f4f7dd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:28.293121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:28.311855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57361ee-9170-489a-8d75-55362edb61b4 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:28.516516 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:28.517150 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:28.518855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:28.519477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] PATH_INFO: `/v3/projects/5f7b5eb7fa894771847e56f7d2920e7f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:28.523078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7b5eb7fa894771847e56f7d2920e7f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:28.526815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:28.664984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7b5eb7fa894771847e56f7d2920e7f', 'request_id': 'req-54491079-d2b5-43ce-9eac-f11cab13f592'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:28.704905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7b5eb7fa894771847e56f7d2920e7f', 'request_id': 'req-54491079-d2b5-43ce-9eac-f11cab13f592'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:28.724054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7b5eb7fa894771847e56f7d2920e7f', 'request_id': 'req-54491079-d2b5-43ce-9eac-f11cab13f592'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:28.765176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] The token cache is being invalidate because project 5f7b5eb7fa894771847e56f7d2920e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:28.765614 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:28.768774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:28.772604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1140/2281] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:28 2022] DELETE /identity/v3/projects/5f7b5eb7fa894771847e56f7d2920e7f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:28.778580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:28.780810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:28.844641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2179b4-e5dc-4550-99e5-d6dc1c20d6d8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:28.977187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:28.979213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:28.980014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:28.980625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] PATH_INFO: `/v3/users/3944359c5f034fef912118975c696d94` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:28.983756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3944359c5f034fef912118975c696d94)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:28.986835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:29.066951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:29.097148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3944359c5f034fef912118975c696d94'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:29.099617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3944359c5f034fef912118975c696d94'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:29.100400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3944359c5f034fef912118975c696d94'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:29.122138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3944359c5f034fef912118975c696d94'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:29.181343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3944359c5f034fef912118975c696d94'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:29.227951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1142/2282] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:28 2022] DELETE /identity/v3/users/3944359c5f034fef912118975c696d94 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:29.629572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:29.631032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:29.633949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:29.636085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:29.662058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54491079-d2b5-43ce-9eac-f11cab13f592 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:29.763830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:29.892971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02b80-6f6e-4962-8faf-8a952db077a1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:29.909324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:29.911024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:29.912321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:29.913968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] PATH_INFO: `/v3/projects/261a8878656848d9979ade71080707f8` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:29.917187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261a8878656848d9979ade71080707f8)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:29.923884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:29.924602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:29.930446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:29.930628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:29.930912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] PATH_INFO: `/v3/users/d40b81fc74cc4747bb71e9ec700fea3f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:29.937815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40b81fc74cc4747bb71e9ec700fea3f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:29.945716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:30.111260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261a8878656848d9979ade71080707f8', 'request_id': 'req-3b28a00b-e322-4e83-a5ca-f37283391728'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.118773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40b81fc74cc4747bb71e9ec700fea3f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.121852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40b81fc74cc4747bb71e9ec700fea3f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.124148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40b81fc74cc4747bb71e9ec700fea3f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.127037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261a8878656848d9979ade71080707f8', 'request_id': 'req-3b28a00b-e322-4e83-a5ca-f37283391728'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.147912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261a8878656848d9979ade71080707f8', 'request_id': 'req-3b28a00b-e322-4e83-a5ca-f37283391728'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.158799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40b81fc74cc4747bb71e9ec700fea3f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.163168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] The token cache is being invalidate because project 261a8878656848d9979ade71080707f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:30.163814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.164958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3b28a00b-e322-4e83-a5ca-f37283391728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.171616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1143/2283] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:29 2022] DELETE /identity/v3/projects/261a8878656848d9979ade71080707f8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:35:30.172587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-480f86a8-2d05-4598-92dc-42508619dd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40b81fc74cc4747bb71e9ec700fea3f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.175040 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.176060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.176341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.200829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1141/2284] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:29 2022] DELETE /identity/v3/users/d40b81fc74cc4747bb71e9ec700fea3f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:30.210093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fa0f2-c10e-460f-93d1-0bd67418aa6c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.210375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fa0f2-c10e-460f-93d1-0bd67418aa6c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.210982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fa0f2-c10e-460f-93d1-0bd67418aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.220598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:30.224634 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.259338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-507fa0f2-c10e-460f-93d1-0bd67418aa6c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:30.260704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-507fa0f2-c10e-460f-93d1-0bd67418aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.301899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:30.361420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1144/2285] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:30.361420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:30.368824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.384190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1142/2286] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:30.391491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03833-6e87-44b5-825b-fd011f271252 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:30.393211 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.393538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.393822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.399352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:30.400917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.401407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.401908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] PATH_INFO: `/v3/users/49ad21565f9340deaf381edf90026afd` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.404069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ad21565f9340deaf381edf90026afd)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:30.407418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:30.453432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:30.456604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.467239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1143/2287] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:30.468305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:30.473971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.516043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ad21565f9340deaf381edf90026afd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.517208 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ad21565f9340deaf381edf90026afd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.518161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ad21565f9340deaf381edf90026afd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.536605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ad21565f9340deaf381edf90026afd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.538373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:30.571960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ad21565f9340deaf381edf90026afd'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:30.581360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cac9c-3db7-4be1-9516-4d4d93c3bfef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:30.586033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:30.589487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.590727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.591726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.595454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.597745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1145/2288] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:30 2022] DELETE /identity/v3/users/49ad21565f9340deaf381edf90026afd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:30.599183 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:30.601130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.622806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:30.626797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ec0-d9e0-40b2-a357-0bd2380a453a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:30.653396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1144/2289] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:30.679671 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.680123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.680400 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.719008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ca700-7101-40aa-94bf-3e37bbc97d7e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:30.725306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:30.726457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.726869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.727277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.729829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:30.729829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:30.732288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:30.752798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1146/2290] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:30.759243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:30.777783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cbda-ca06-447a-858c-ad1142f4c13d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:30.778474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:30.780421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.785459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:30.786420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:30.786936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:30.787454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:30.788380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:30.803549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:30.829825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1145/2291] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:30.849453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:30.851939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:30.894878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1147/2292] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:30.898876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.007694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:31.105783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4e7d-96f1-4c4d-86d7-6c946cde4db7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.141254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45406f-23ea-43b5-a12e-087f10d53d49 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.154366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.155013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.155867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.156142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.156793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.158785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.216742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1148/2293] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:30 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:35:31.232013 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.247798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.248759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.249195 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.249608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.253210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59bfb-63fe-4994-bea7-5ecf8001e657 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.265764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.266074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.267302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.267480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.268007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.268650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.269587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.272971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.280229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1146/2294] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:35:31.291788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1149/2295] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:31.296222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.310815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad5748-6a5b-487b-9048-9edebb853e33 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.316687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.317445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.317802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.318028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.318718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.320746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0f276-e01a-4b3c-be08-602901940164 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.348636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1147/2296] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:31.353571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.371006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c1e7-ec25-480e-93d8-7966236a99bc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.383859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.408249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.412344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.412344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] PATH_INFO: `/v3/projects/4b2a2daa07e2461f8200eb816bb455ec/users/9a7e6db8891c4ef78128f746133ff165/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.468697 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2a2daa07e2461f8200eb816bb455ec, user_id=9a7e6db8891c4ef78128f746133ff165, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.473410 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.505839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1150/2297] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:31 2022] PUT /identity/v3/projects/4b2a2daa07e2461f8200eb816bb455ec/users/9a7e6db8891c4ef78128f746133ff165/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:31.520416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.521377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.521919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.561321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] MFA Rules not processed for user `9a7e6db8891c4ef78128f746133ff165`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:31.562763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:31.680022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1148/2298] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:31.697289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.699660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:31.831840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965755-c3d7-4934-b769-b9a21dd2e133 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:31.839819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:31.841261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:31.841876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:31.843106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:31.866688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:31.868964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826dbfb-c6c1-457f-8832-9dceb5bb1aa3 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:31.889528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1151/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:31.891891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:31.893342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:31.912239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:32.001088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:32.001648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:32.002178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:32.115870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] MFA Rules not processed for user `e774f9d4502845c8a8df321ced32b1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:32.119570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:32.149378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3097426-ada7-4d5b-8232-ed9d984fcc1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:32.172281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:32.172766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:32.173149 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:32.173533 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] PATH_INFO: `/v3/projects/4a296afc2b724913ae736795085d86a1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:32.182894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a296afc2b724913ae736795085d86a1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:32.204019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:32.340238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a296afc2b724913ae736795085d86a1', 'request_id': 'req-93974a88-2846-4e05-9da7-fbbb6e2c991b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.354275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a296afc2b724913ae736795085d86a1', 'request_id': 'req-93974a88-2846-4e05-9da7-fbbb6e2c991b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.370004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1152/2300] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:32.371051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:32.372820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:32.374178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a296afc2b724913ae736795085d86a1', 'request_id': 'req-93974a88-2846-4e05-9da7-fbbb6e2c991b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.391401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] The token cache is being invalidate because project 4a296afc2b724913ae736795085d86a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:32.392171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.393065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.395597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1149/2301] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:31 2022] DELETE /identity/v3/projects/4a296afc2b724913ae736795085d86a1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:32.396771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:32.398517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:32.425407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06c72-d008-43d0-9e7c-bfd686a3b942 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:32.451899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:32.601853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:32.602548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:32.602828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:32.603104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] PATH_INFO: `/v3/projects/23895be4c5f04ce3a60384a9e8fc88d1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:32.608051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23895be4c5f04ce3a60384a9e8fc88d1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:32.609791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:32.728267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23895be4c5f04ce3a60384a9e8fc88d1', 'request_id': 'req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.754597 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23895be4c5f04ce3a60384a9e8fc88d1', 'request_id': 'req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.783803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23895be4c5f04ce3a60384a9e8fc88d1', 'request_id': 'req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.797894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93974a88-2846-4e05-9da7-fbbb6e2c991b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:32.831823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] The token cache is being invalidate because project 23895be4c5f04ce3a60384a9e8fc88d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:32.832332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.847839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-17e04c1b-ec33-4aee-a27d-34ec640dc7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:32.850525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1153/2302] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:32 2022] DELETE /identity/v3/projects/23895be4c5f04ce3a60384a9e8fc88d1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:32.862153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cd218-9ac3-445f-a588-a3bdcae83d32 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:32.862854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cd218-9ac3-445f-a588-a3bdcae83d32 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:32.863550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cd218-9ac3-445f-a588-a3bdcae83d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:32.902727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-345cd218-9ac3-445f-a588-a3bdcae83d32 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:32.904626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-345cd218-9ac3-445f-a588-a3bdcae83d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:32.928247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:32.949140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:32.950013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:32.950369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:32.950728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:32.954141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:32.960132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.004758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1150/2303] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:32 2022] POST /identity/v3/projects => generated 371 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:33.010878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.013866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:33.079145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1154/2304] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:33.081374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.081829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.082261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.111046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:33.113895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:33.142411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637e91-128e-4701-95db-276dafe4a0bf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.156429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.157527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.157806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.158148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.160427 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.177301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:33.179645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.226776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1151/2305] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:33 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:33.229754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.261010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7d3f1-e841-4a0e-b863-2af633a3972e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.264497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1155/2306] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:33.269525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.282277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.283379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.283892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.284440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.286108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb764d-d0cb-4ce1-a931-b66d464395fe None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.288062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.291778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.296628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.297277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.297550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.301990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.304638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:33.305082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.311614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.329921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1152/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:33.331747 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.344624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a05b8-d406-4391-8ac3-9f06f805c22f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.346085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1156/2308] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:33.351967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.356680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.357488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.357769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.358071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] PATH_INFO: `/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee/users/73384f8e6ac94c63bc2ce995aeda643f/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.375022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5baa9-b84e-4573-b5fb-1b21df3cb2af admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.379226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a9ec1731b14d7f9a812c1acf328aee, user_id=73384f8e6ac94c63bc2ce995aeda643f, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.382225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.383508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.384471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.384933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.385418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.386240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.389210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.416599 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1153/2309] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:33 2022] PUT /identity/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee/users/73384f8e6ac94c63bc2ce995aeda643f/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:33.417569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.455961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1157/2310] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:33 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:33.457678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.534769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44ceb-3780-4743-b4e3-7b896c971676 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.585234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7850d12-f7b6-4c8f-a91a-b1b8d1210927 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.590954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.591778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.592272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.592646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.593477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.595743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.598569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:33.640846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.641847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.642142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.642522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.647035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.647257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1158/2311] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:33 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:33.647375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.649553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.657073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1154/2312] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:33.662731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.666719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc3a3-477f-4362-9c9a-483962d2c2d5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.672235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.672864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.673143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.673416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.674484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.678453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.686450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a4049-a5e1-4f0e-ac32-fd752fd2748e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.695307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1159/2313] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:33.696778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.702131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.703226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.704404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.704800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] PATH_INFO: `/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee/users/73384f8e6ac94c63bc2ce995aeda643f/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.710998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a9ec1731b14d7f9a812c1acf328aee, user_id=73384f8e6ac94c63bc2ce995aeda643f, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.712674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef229-bd6c-47dd-83d4-5262ae05f490 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.718428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.723406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.724385 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.724767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.726704 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.727914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.730034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a421-d709-4a50-bfb2-647e801e3abc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:33.741632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1155/2314] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:33 2022] PUT /identity/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee/users/73384f8e6ac94c63bc2ce995aeda643f/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:33.761181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1160/2315] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:33.765998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:33.900746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7bf5e-0a23-4250-8cf8-215ac625224c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:33.909509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:33.911328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:33.912171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:33.912860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] PATH_INFO: `/v3/projects/1fae3f63e94a4bfc9f0863e1a09807fc/users/1387566394594b66a6a5a97a1b5e5fa9/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:33.966250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fae3f63e94a4bfc9f0863e1a09807fc, user_id=1387566394594b66a6a5a97a1b5e5fa9, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:33.971391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:34.008154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1156/2316] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:33 2022] PUT /identity/v3/projects/1fae3f63e94a4bfc9f0863e1a09807fc/users/1387566394594b66a6a5a97a1b5e5fa9/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:34.009966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e26f-73e6-444b-8c42-9ea95ea9ccd8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:34.010285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e26f-73e6-444b-8c42-9ea95ea9ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:34.010527 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e26f-73e6-444b-8c42-9ea95ea9ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:34.052554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e175e26f-73e6-444b-8c42-9ea95ea9ccd8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:34.055165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e175e26f-73e6-444b-8c42-9ea95ea9ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:34.167174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1161/2317] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:34.186672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:34.188628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:34.266566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da9a1-64af-40d0-82e0-746f507f379b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:34.270817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:34.271606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:34.271888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:34.272164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:34.289117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:34.291791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:34.308351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1157/2318] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:43.919306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:43.919306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:43.920067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:44.018119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:44.019778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:44.076159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:44.239186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1162/2319] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:44.267050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:44.268837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:44.434559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:44.544418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf899b9-88d8-43ff-8e39-66bb28b6972f service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:44.570708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:44.571818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:44.573822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:44.573822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:44.596081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:44.598298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13851ea-ddf0-4d19-b28c-124d087cbb21 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:44.620035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1158/2320] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:35:46.335384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:46.337187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:46.364245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66e9b2-cd0a-44bd-b980-0ca78078082f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:46.379538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:46.381703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:46.383007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:46.383007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] PATH_INFO: `/v3/users/9a7e6db8891c4ef78128f746133ff165` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:46.389890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7e6db8891c4ef78128f746133ff165)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:46.400676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:46.512728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7e6db8891c4ef78128f746133ff165'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:46.513514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7e6db8891c4ef78128f746133ff165'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:46.514450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7e6db8891c4ef78128f746133ff165'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:46.537894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7e6db8891c4ef78128f746133ff165'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:46.564317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7e6db8891c4ef78128f746133ff165'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:46.598001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1163/2321] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:46 2022] DELETE /identity/v3/users/9a7e6db8891c4ef78128f746133ff165 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:46.600947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a928-ebf7-49ac-9488-6fad2c030812 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:46.602931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a928-ebf7-49ac-9488-6fad2c030812 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:46.603592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a928-ebf7-49ac-9488-6fad2c030812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:46.711926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f2b5a928-ebf7-49ac-9488-6fad2c030812 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:46.714530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f2b5a928-ebf7-49ac-9488-6fad2c030812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:46.983744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1159/2322] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:46.994838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:46.996502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:47.188248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e93ce-070d-49b1-af9f-b0d484651484 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:47.196246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:47.197605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:47.198274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:47.198720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:47.217783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:47.220458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:47.243934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1164/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:48.441884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:48.447019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:48.447330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:48.519988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] MFA Rules not processed for user `73384f8e6ac94c63bc2ce995aeda643f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:48.521573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:48.693463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1160/2324] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:48.771702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:48.774559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:48.863491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:48.945150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c300-78fb-4d36-be59-f0f006d9e69d service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:48.953146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:48.953889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:48.954242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:48.954583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:48.957098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:49.083699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:49.087134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d907e3-a93e-4e0a-9cdf-99a366ae6044 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:49.123476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1165/2325] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:49.285865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:49.287672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:49.346835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c18a7-4194-4c8a-8148-f8e7dc458965 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:49.360424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:49.361378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:49.361659 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:49.361937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] PATH_INFO: `/v3/projects/4b2a2daa07e2461f8200eb816bb455ec` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:49.363278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2a2daa07e2461f8200eb816bb455ec)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:49.365804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:49.485660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2a2daa07e2461f8200eb816bb455ec', 'request_id': 'req-4b6dfe76-f350-47d2-a5c3-f684304cb709'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:49.487159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:49.500860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2a2daa07e2461f8200eb816bb455ec', 'request_id': 'req-4b6dfe76-f350-47d2-a5c3-f684304cb709'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:49.518303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2a2daa07e2461f8200eb816bb455ec', 'request_id': 'req-4b6dfe76-f350-47d2-a5c3-f684304cb709'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:49.544233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] The token cache is being invalidate because project 4b2a2daa07e2461f8200eb816bb455ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:49.544609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:49.550331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b6dfe76-f350-47d2-a5c3-f684304cb709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:49.552363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1161/2326] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:49 2022] DELETE /identity/v3/projects/4b2a2daa07e2461f8200eb816bb455ec => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:49.559748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:49.560038 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:49.560753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:49.607973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:49.613983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:49.798629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1166/2327] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:49.806710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025a38-bdcb-4bb0-9a53-2ef4a4f3f9dd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:49.807329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025a38-bdcb-4bb0-9a53-2ef4a4f3f9dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:49.807766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025a38-bdcb-4bb0-9a53-2ef4a4f3f9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:49.859877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-22025a38-bdcb-4bb0-9a53-2ef4a4f3f9dd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:49.861162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22025a38-bdcb-4bb0-9a53-2ef4a4f3f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:49.901571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1162/2328] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:49.905739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:49.920112 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322cb7-1803-400a-9a6f-4c5cf56fab84 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:49.941242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:49.941893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:49.942174 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:49.946321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:49.947212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:49.952275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:49.956662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:49.996026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:49.996958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:49.997469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.020520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1167/2329] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:50.021907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.046627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9878d-44eb-4b52-b1c8-21f71dfdf009 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.070078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.070834 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.071175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.071554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.072290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.074413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.113575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] MFA Rules not processed for user `1387566394594b66a6a5a97a1b5e5fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:50.115066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:50.137743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1168/2330] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:50 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:50.139402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.228941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:50.310245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1d00-4b9e-41e7-8489-7fb707537e3f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.318997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.319837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.320125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.320404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.321054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.328963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.333175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1163/2331] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:50.338781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.341807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:50.375436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c410fa-bdec-431c-bf9b-72d193e80780 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.382475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1169/2332] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:50 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:50.387847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.394558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.395222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.395512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.395784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.396436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.398381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.410885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814240d-0953-4ff4-8ea7-24a8078c7175 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.421332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.421986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.422271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.422556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.423335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.425549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.450376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1170/2333] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:50.457011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.465324 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1164/2334] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:50 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:50.469453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.489052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122b9d-95ff-4ca8-8279-8443daace25c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.620532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a7777-c32b-492b-819c-3b2f8106bb70 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.635971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.636897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.637368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.637794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.638592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.640731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.678687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.679546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.680756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.681065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.681996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.685088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.690385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1165/2335] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:50 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:50.694482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.708583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1171/2336] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:50.710204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.719644 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9a6ac-f825-4975-a990-cf1ccad9cb4a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.724919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3b0f6-2250-47af-9762-f31fa4efabe4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.731377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.732128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.732415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.732694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] PATH_INFO: `/v3/projects/acd454d7bd6f416abc824e5045057a66/users/667f8cd44f0e48cca6927b62f5af5f31/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.735564 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.736434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.736897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.737420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.738285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.742004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.757775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd454d7bd6f416abc824e5045057a66, user_id=667f8cd44f0e48cca6927b62f5af5f31, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.763232 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54855ccf-a272-41b1-8fbe-f2f53fdcfe02 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:50.785717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1166/2337] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:35:50.787017 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:50.795250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1172/2338] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:50 2022] PUT /identity/v3/projects/acd454d7bd6f416abc824e5045057a66/users/667f8cd44f0e48cca6927b62f5af5f31/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:50.811671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.812998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.813729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.815776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc934-da20-4e18-a3f7-13b807f1476c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:50.833120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:50.904676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] MFA Rules not processed for user `667f8cd44f0e48cca6927b62f5af5f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:50.907420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:50.933592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:50.934350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:50.934750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:50.934882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] PATH_INFO: `/v3/projects/cd757823774d4c2184e39c05b6b4943f/users/a1498a7c101349ad83afe9c183cb8e99/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:50.972686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd757823774d4c2184e39c05b6b4943f, user_id=a1498a7c101349ad83afe9c183cb8e99, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:50.980047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:51.007378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1167/2339] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:50 2022] PUT /identity/v3/projects/cd757823774d4c2184e39c05b6b4943f/users/a1498a7c101349ad83afe9c183cb8e99/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:51.011561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:51.165095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1173/2340] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:51.182123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:51.184448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:51.199060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc09a87-ffe9-4d08-ac4c-49aa141e376e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:51.212566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:51.213493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:51.213910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:51.214346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:51.215328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:51.217956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:51.226187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:51.263590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1168/2341] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:51.265808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:51.278896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40ab2-f445-43eb-9413-fbc8c60f4ab1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:51.283864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:51.284606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:51.285057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:51.285326 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] PATH_INFO: `/v3/projects/cd757823774d4c2184e39c05b6b4943f/users/a1498a7c101349ad83afe9c183cb8e99/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:51.287431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd757823774d4c2184e39c05b6b4943f, user_id=a1498a7c101349ad83afe9c183cb8e99, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:51.290192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:51.310163 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1169/2342] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:51 2022] PUT /identity/v3/projects/cd757823774d4c2184e39c05b6b4943f/users/a1498a7c101349ad83afe9c183cb8e99/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:35:51.355436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392534e3-83d9-4ce7-ac3c-8227ff15c7f0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:51.533129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:51.533804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:51.534146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:51.534522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:51.705934 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:51.708545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4db31-0651-421e-b58d-e4bcbcdc29a9 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:51.743622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1174/2343] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:51.765955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:52.041156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052ee25-dd5f-460c-bb79-12c90fbeee3c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:52.080622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:52.081731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:52.082519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:52.082996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] PATH_INFO: `/v3/users/667f8cd44f0e48cca6927b62f5af5f31` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:52.092187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667f8cd44f0e48cca6927b62f5af5f31)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:52.096025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:52.209848 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:52.256980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667f8cd44f0e48cca6927b62f5af5f31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:52.259653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667f8cd44f0e48cca6927b62f5af5f31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:52.260746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667f8cd44f0e48cca6927b62f5af5f31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:52.299168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667f8cd44f0e48cca6927b62f5af5f31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:52.320013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667f8cd44f0e48cca6927b62f5af5f31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:52.360411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1170/2344] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:35:51 2022] DELETE /identity/v3/users/667f8cd44f0e48cca6927b62f5af5f31 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:52.361522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27a75-70e9-4507-b36a-b55b0ab03a36 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:52.362029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27a75-70e9-4507-b36a-b55b0ab03a36 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:52.362146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27a75-70e9-4507-b36a-b55b0ab03a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:52.427475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-23c27a75-70e9-4507-b36a-b55b0ab03a36 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:52.433825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-23c27a75-70e9-4507-b36a-b55b0ab03a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:52.719134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1175/2345] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:35:52.815439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:52.815439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:53.045498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c76d4-c53e-4d2d-9d8c-420d807f46b4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:53.066900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:53.067585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:53.067869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:53.068142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:53.099060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:53.100632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:53.117885 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1171/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:35:53.426483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a28d8-31ad-4ad2-aaef-ed260a9591ac None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:53.426483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a28d8-31ad-4ad2-aaef-ed260a9591ac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:53.426483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a28d8-31ad-4ad2-aaef-ed260a9591ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:53.470575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bc1a28d8-31ad-4ad2-aaef-ed260a9591ac None None] MFA Rules not processed for user `e774f9d4502845c8a8df321ced32b1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:53.477563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bc1a28d8-31ad-4ad2-aaef-ed260a9591ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:53.530523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:53.634472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1176/2347] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:55.142629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:55.144392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:55.186260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbbf8b-3980-4823-942c-b53d3aff437b service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:55.204289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:55.205225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:55.205761 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:55.206275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] PATH_INFO: `/v3/projects/acd454d7bd6f416abc824e5045057a66` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:55.208246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd454d7bd6f416abc824e5045057a66)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:55.210393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:55.356802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd454d7bd6f416abc824e5045057a66', 'request_id': 'req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:55.383949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd454d7bd6f416abc824e5045057a66', 'request_id': 'req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:55.411281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd454d7bd6f416abc824e5045057a66', 'request_id': 'req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:55.469543 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] The token cache is being invalidate because project acd454d7bd6f416abc824e5045057a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:35:55.473727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:55.477444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ce9d0de-6fbf-46f2-88ca-f679dd24ef3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:35:55.497067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1172/2348] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:35:55 2022] DELETE /identity/v3/projects/acd454d7bd6f416abc824e5045057a66 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:55.503049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:55.503588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:55.503588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:55.543251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:55.544732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:55.708667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1177/2349] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:55.719849 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:55.721500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:55.723187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:55.798552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:55.806686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:55.868694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1173/2350] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:55.869893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:55.899713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf63178-8503-4f55-91a5-947b008e1364 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:55.966272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:55.968491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:55.969879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:55.970549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:55.977293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:35:55.980440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:55.992039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.055872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1178/2351] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:35:56.061438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:56.077627 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fced57-3ca5-437b-9c7d-1763530fd2aa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:56.102504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:56.103810 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.104247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.104519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.105202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:56.108112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.177040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:56.200796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1174/2352] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:35:56 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:35:56.201403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:56.231019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651a66-e9c7-453e-b918-c4db6ee05d82 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:56.359549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:56.360302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.360588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.360865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.364431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:56.366587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.460842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:56.474748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1179/2353] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:35:56 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:35:56.480055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4d50-5f87-48b9-af11-4fd549695a8d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:56.500375 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:56.504145 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.508320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.509191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.510348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:56.512388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.561901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:56.576484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1175/2354] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:56.604931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3793be2-e74a-49ce-9a8d-e00cdf4a3f5d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:56.638332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:56.639252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.641706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.642976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.646787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:56.654056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4080d-4a74-459c-b71f-aa7e4e3649ae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.724239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:56.729482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1180/2355] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:35:56.756233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaa19-a281-4e06-92b5-e0d6b9c90694 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:56.778978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:56.786595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.786797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.787082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] PATH_INFO: `/v3/projects/f4d06ef6b30b48c1a7b3ff89d4e1a3f3/users/2984e115f4414120a41590ca8d2f9da3/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.875254 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d06ef6b30b48c1a7b3ff89d4e1a3f3, user_id=2984e115f4414120a41590ca8d2f9da3, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:56.878908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:56.942650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1176/2356] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:35:56 2022] PUT /identity/v3/projects/f4d06ef6b30b48c1a7b3ff89d4e1a3f3/users/2984e115f4414120a41590ca8d2f9da3/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:35:56.948074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d982b0-f393-4aff-b3fb-a29bda1dc946 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:56.949115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d982b0-f393-4aff-b3fb-a29bda1dc946 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:56.949678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d982b0-f393-4aff-b3fb-a29bda1dc946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:56.997625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-97d982b0-f393-4aff-b3fb-a29bda1dc946 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:57.000664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-97d982b0-f393-4aff-b3fb-a29bda1dc946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:57.149181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:35:57.211159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1181/2357] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:57.237799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:57.240058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:57.443069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39f8-ea77-4115-b120-0ac32c068213 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:57.457664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:57.458884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:57.459366 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:57.459813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:57.478619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:57.485433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0209f-c1ae-4a28-865c-098cc3af80ec service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:57.521136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1177/2358] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:35:58.323427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4098d-70cd-40c7-afb8-edf68a14c047 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:58.324084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4098d-70cd-40c7-afb8-edf68a14c047 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:58.324084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4098d-70cd-40c7-afb8-edf68a14c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:58.367216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c1e4098d-70cd-40c7-afb8-edf68a14c047 None None] MFA Rules not processed for user `b6f176b6404d417a96681dd2ee77d095`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:58.373267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c1e4098d-70cd-40c7-afb8-edf68a14c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:58.529968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1182/2359] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:59.071321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:59.071811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:59.071811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:59.118200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] MFA Rules not processed for user `cd53375218ec492e8e250efe42b3d09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:59.120612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:59.248306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1178/2360] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:59.494228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9a90-a8c5-42f2-a3b3-3a729feb5ff1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:59.495302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9a90-a8c5-42f2-a3b3-3a729feb5ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:59.495738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9a90-a8c5-42f2-a3b3-3a729feb5ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:59.534826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-410f9a90-a8c5-42f2-a3b3-3a729feb5ff1 None None] MFA Rules not processed for user `2984e115f4414120a41590ca8d2f9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:35:59.536628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-410f9a90-a8c5-42f2-a3b3-3a729feb5ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:59.645950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1183/2361] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:35:59.659479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:35:59.661024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:35:59.759000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f166a-9a88-49e5-b195-db7a779a7659 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:35:59.766811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:35:59.767902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:35:59.768394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:35:59.768904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:35:59.780983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:35:59.782807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3a8c-6b79-4a67-b022-bc9b82f5e36b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:35:59.813679 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1179/2362] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:01.209548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:01.210388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:01.210695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:01.250542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] MFA Rules not processed for user `a1498a7c101349ad83afe9c183cb8e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:01.251680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:01.358638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:01.371061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1184/2363] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:01.576094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a107-ad57-4842-bc9a-4e35f5c5469a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:01.576524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a107-ad57-4842-bc9a-4e35f5c5469a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:01.576524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a107-ad57-4842-bc9a-4e35f5c5469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:01.614313 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4e99a107-ad57-4842-bc9a-4e35f5c5469a None None] MFA Rules not processed for user `2984e115f4414120a41590ca8d2f9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:01.615814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e99a107-ad57-4842-bc9a-4e35f5c5469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:01.627854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1180/2364] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:05.081274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:05.085334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:05.186248 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856ad7e-17b2-46bd-a3d9-90507ba91619 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:05.190647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:05.191169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:05.191504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:05.191789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:05.193828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:05.259418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:05.260893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:05.271340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1185/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:05.477879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f487d1-2402-4db4-991d-1693b1e0a6bf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:05.479079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f487d1-2402-4db4-991d-1693b1e0a6bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:05.479598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f487d1-2402-4db4-991d-1693b1e0a6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:05.505337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-35f487d1-2402-4db4-991d-1693b1e0a6bf None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:05.508430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35f487d1-2402-4db4-991d-1693b1e0a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:05.514606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:05.594781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1181/2366] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:05.614179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:05.616987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:05.731295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc7bc-e1f3-4381-a318-899129188c2d service glance] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:05.737979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:05.738622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:05.738896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:05.739162 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:05.753722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:05.756716 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6a3a-93c8-49e0-bdba-ac026e6a72a5 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:05.781206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1186/2367] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:15.582493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=21 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:15.766201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:16.289993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.290404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.290901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.308920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1182/2368] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:36:16 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:36:16.316285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba7435-8f73-4dd1-8805-a943ef80d18d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.317006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba7435-8f73-4dd1-8805-a943ef80d18d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.317411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba7435-8f73-4dd1-8805-a943ef80d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.347985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d9ba7435-8f73-4dd1-8805-a943ef80d18d None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:16.349888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d9ba7435-8f73-4dd1-8805-a943ef80d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:16.527772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1187/2369] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:16.535373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:16.538437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:16.558491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4915-cc50-4e81-ab4d-39435c1c3187 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:16.564331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:16.565364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.565889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.566458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.587737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:16.593778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072012d-b739-40fa-a9f9-d6de40154c94 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:16.625131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1183/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:16.769841 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.771713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.774487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.776622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1188/2371] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:36:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:36:16.787841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254a47-bc1c-4c37-bb4c-67cfbb1ecb54 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.788585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254a47-bc1c-4c37-bb4c-67cfbb1ecb54 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.789197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254a47-bc1c-4c37-bb4c-67cfbb1ecb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.825509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cf254a47-bc1c-4c37-bb4c-67cfbb1ecb54 None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:16.827382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf254a47-bc1c-4c37-bb4c-67cfbb1ecb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:16.850961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1184/2372] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:16.883245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:16.885341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:16.909123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ec8f-0bb8-4f0c-9881-f5cf9c6bd064 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:16.919514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:16.920176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:16.920436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:16.920711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:16.944497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:16.945993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc19d8-94fb-482c-8706-58b53e34a8ea service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:16.968750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1189/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:17.275689 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f5-85eb-4b2f-a74e-ffa810c7b7f0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:17.276416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f5-85eb-4b2f-a74e-ffa810c7b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:17.277015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f5-85eb-4b2f-a74e-ffa810c7b7f0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:17.279970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1185/2374] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:36:17.289565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99108-f739-4848-b63b-d5711f08860d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:17.290440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99108-f739-4848-b63b-d5711f08860d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:17.291408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99108-f739-4848-b63b-d5711f08860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:17.335062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-65e99108-f739-4848-b63b-d5711f08860d None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:17.338298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-65e99108-f739-4848-b63b-d5711f08860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:17.366367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1190/2375] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:17.390613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17b5f5-85eb-4b2f-a74e-ffa810c7b7f0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:17.407019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17b5f5-85eb-4b2f-a74e-ffa810c7b7f0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:17.412294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:17.413923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:17.414408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:17.414919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:17.451743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:17.457611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ab5d7-a130-44e8-bc8e-8e29602217c6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:17.477569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1186/2376] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:21.707656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:21.708246 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:21.708642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:21.744301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] MFA Rules not processed for user `1387566394594b66a6a5a97a1b5e5fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:21.746412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:21.764532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1191/2377] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:27.471669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=15 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:27.812268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:27.812721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:27.813165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:27.862878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:27.864457 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:27.873612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1187/2378] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:27.914371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:27.930565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f005-8862-4f1f-a58c-e2c4cd7814a1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:27.936926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:27.937595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:27.937888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:27.938217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:27.950339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:27.952700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:27.963764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1192/2379] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:37.841129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:37.959580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=49 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:41.047236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:41.048422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:41.147966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f3f5-a45c-4681-8776-f613fa3efeb0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:41.153219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:41.153914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:41.154186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:41.154447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:41.156459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:41.174645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:41.177067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d40dd-05d0-480c-8469-62112b3f2bf3 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:41.188873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1188/2380] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:36:43.612142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:43.623322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f46ac-f1ac-4a88-a58a-2e202d7183f2 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:43.628389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:43.630021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:43.630458 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:43.630880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:43.633130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:43.709799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:43.712791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:43.743955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1193/2381] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:36:43.942508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb9fa-931c-4dfc-a0f2-2eb3907f99c7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:43.943055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb9fa-931c-4dfc-a0f2-2eb3907f99c7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:43.943296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fb9fa-931c-4dfc-a0f2-2eb3907f99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:43.981779 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-383fb9fa-931c-4dfc-a0f2-2eb3907f99c7 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:43.984563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-383fb9fa-931c-4dfc-a0f2-2eb3907f99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:44.000384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1189/2382] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:36:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:44.018372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:44.040744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b2dc-4a84-40dc-84a4-d197dab3052c service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:44.048815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:44.050540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:44.051061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:44.051581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:44.069113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:44.086059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:44.106822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1194/2383] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:36:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:45.788343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326e45-34d4-4e68-8530-d913e2748df1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:45.789382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326e45-34d4-4e68-8530-d913e2748df1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:45.789906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326e45-34d4-4e68-8530-d913e2748df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:45.814205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c0326e45-34d4-4e68-8530-d913e2748df1 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:45.815862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0326e45-34d4-4e68-8530-d913e2748df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:45.831835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1190/2384] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:36:45.844855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:45.857362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba545-a250-4f5c-a931-cb345df4f7a3 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:45.866601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:45.867312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:45.867784 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:45.868212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:45.881695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:45.884710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:45.905302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1195/2385] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:55.806871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=38 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:55.891028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=42 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:36:56.712703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28574a5-ee3e-4c4d-aa50-e48f1aaa847f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:56.712985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28574a5-ee3e-4c4d-aa50-e48f1aaa847f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:56.713263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28574a5-ee3e-4c4d-aa50-e48f1aaa847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:56.739246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c28574a5-ee3e-4c4d-aa50-e48f1aaa847f None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:56.740857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c28574a5-ee3e-4c4d-aa50-e48f1aaa847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:56.749062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1191/2386] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:36:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:36:56.764863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:56.783321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc28a2f-7971-460f-bf04-a9fa5ded7d24 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:56.789608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:56.790238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:56.790515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:56.790789 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:56.801623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:56.803797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:56.813741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1196/2387] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:36:59.240450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f3-9bdd-4667-8603-53b779c42cb4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:59.241093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f3-9bdd-4667-8603-53b779c42cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:59.241093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f3-9bdd-4667-8603-53b779c42cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:59.266726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0460e4f3-9bdd-4667-8603-53b779c42cb4 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:36:59.268430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0460e4f3-9bdd-4667-8603-53b779c42cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:59.281655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1192/2388] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:36:59.313773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:36:59.316351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:36:59.344264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02df0e-c770-4010-8ac7-078b08a0538a service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:36:59.357990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:36:59.358628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:36:59.359293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:36:59.359885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:36:59.376427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:36:59.380016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:36:59.399416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1197/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:03.372493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d70e5-8ee0-49db-909d-28050b8667ce None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:03.373047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d70e5-8ee0-49db-909d-28050b8667ce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:03.373252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d70e5-8ee0-49db-909d-28050b8667ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:03.405630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4a4d70e5-8ee0-49db-909d-28050b8667ce None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:03.406929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a4d70e5-8ee0-49db-909d-28050b8667ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:03.419923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1193/2390] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:03.450028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:03.459333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5116-20d8-4f69-b47d-c36875afb8e9 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:03.465922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:03.466657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:03.466998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:03.467322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:03.479235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:03.481064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:03.507067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1198/2391] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:04.784183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:04.784757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:04.784862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:04.805813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:04.807168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:04.815119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1194/2392] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:04.829029 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:04.841140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e767e-41f6-42b9-8f98-7e266f259de4 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:04.846392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:04.846981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:04.847317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:04.847586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:04.858008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:04.859653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:04.871362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1199/2393] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:37:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:37:07.183371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:07.185012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.201748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3986f-044f-471f-9da2-0fd1cf4d8965 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:07.207840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:07.208489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.208768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.209031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] PATH_INFO: `/v3/users/b6f176b6404d417a96681dd2ee77d095` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.210609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f176b6404d417a96681dd2ee77d095)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:07.212640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:07.292546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f176b6404d417a96681dd2ee77d095'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.294765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f176b6404d417a96681dd2ee77d095'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.295568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f176b6404d417a96681dd2ee77d095'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.314987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f176b6404d417a96681dd2ee77d095'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.326171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-61c9ed52-93c7-4f12-a0f3-847a929d6c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f176b6404d417a96681dd2ee77d095'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.341915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1195/2394] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:37:07 2022] DELETE /identity/v3/users/b6f176b6404d417a96681dd2ee77d095 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:07.639851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:07.657011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b47ea7-0dcd-415e-a55e-259e5f5fcc63 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:07.679336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.679850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.680746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.713645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:07.715036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.738298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:07.739832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.740227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.740594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] PATH_INFO: `/v3/projects/98be7cddeba64b568c8c2d603f43acc1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.742779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98be7cddeba64b568c8c2d603f43acc1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:07.746240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:07.789670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1196/2395] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:07.804732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98be7cddeba64b568c8c2d603f43acc1', 'request_id': 'req-28838f40-a037-42a5-8d5b-e8cb799d7468'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.812171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98be7cddeba64b568c8c2d603f43acc1', 'request_id': 'req-28838f40-a037-42a5-8d5b-e8cb799d7468'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.812606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:07.814076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.820532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98be7cddeba64b568c8c2d603f43acc1', 'request_id': 'req-28838f40-a037-42a5-8d5b-e8cb799d7468'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.833005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] The token cache is being invalidate because project 98be7cddeba64b568c8c2d603f43acc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:37:07.833291 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.833955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-28838f40-a037-42a5-8d5b-e8cb799d7468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:07.835518 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1200/2396] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:37:07 2022] DELETE /identity/v3/projects/98be7cddeba64b568c8c2d603f43acc1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:07.840331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8afd-52be-4ab5-9882-0f8555441ba1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.840610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8afd-52be-4ab5-9882-0f8555441ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.840881 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b8afd-52be-4ab5-9882-0f8555441ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.863071 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d97b8afd-52be-4ab5-9882-0f8555441ba1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:07.865031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d97b8afd-52be-4ab5-9882-0f8555441ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.866285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:07.893381 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649d97-37fa-477c-810d-067a3f982a95 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:07.898696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:07.927981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1201/2397] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:37:07.935727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256dd87-a803-4110-acff-140f8e39885b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.936468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256dd87-a803-4110-acff-140f8e39885b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.936926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256dd87-a803-4110-acff-140f8e39885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.957167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9256dd87-a803-4110-acff-140f8e39885b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:07.958623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:07.958788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9256dd87-a803-4110-acff-140f8e39885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.959285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.959615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.959887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.961735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:07.968957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1202/2398] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:37:07.973488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256dd87-a803-4110-acff-140f8e39885b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:07.973692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:07.975349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:07.983042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256dd87-a803-4110-acff-140f8e39885b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:07.985471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1197/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:07.987898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:07.988525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:07.988798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:07.989146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:07.989788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:37:07.990083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:07.991997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.003541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1203/2400] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:37:08.008264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.026128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a43b1-6351-4156-a71e-4f7e73c7f934 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.028088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.028706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.028979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.029249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.029875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.034180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.070685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1198/2401] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:37:08 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:37:08.072371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.083595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e0f-2ab8-4d9c-84ca-1fd9de376a99 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.145811 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.146440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.146739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.147008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.147747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.149822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.173238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1204/2402] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:37:08 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:37:08.177293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.187946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7f40-a4f8-49bc-b9c8-d795419e01cf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.192797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.193411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.193693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.195104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.195833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.197448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.211478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1199/2403] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:37:08.212691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.223838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff370c-26e7-4f0d-9586-6192c46215cc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.229534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.230156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.230429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.230681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.231386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.232982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730802f6-6306-4a75-ba30-eb66ad7555a1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.244212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1205/2404] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:37:08.248718 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.259431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fbb43-696c-40d3-8a28-7595f5174fc8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.264358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.265024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.265297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.265552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] PATH_INFO: `/v3/projects/1be3d1d670fa4536aab0891eba12ccfd/users/7472afa0494640bd9db95cfd8be838ca/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.282289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be3d1d670fa4536aab0891eba12ccfd, user_id=7472afa0494640bd9db95cfd8be838ca, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.284976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.299042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1200/2405] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:37:08 2022] PUT /identity/v3/projects/1be3d1d670fa4536aab0891eba12ccfd/users/7472afa0494640bd9db95cfd8be838ca/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:08.309739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d09d7-cec4-4f87-bf43-710f8120de29 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.310135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d09d7-cec4-4f87-bf43-710f8120de29 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.310465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d09d7-cec4-4f87-bf43-710f8120de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.339143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8d0d09d7-cec4-4f87-bf43-710f8120de29 None None] MFA Rules not processed for user `7472afa0494640bd9db95cfd8be838ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:08.340665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8d0d09d7-cec4-4f87-bf43-710f8120de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:08.408384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1206/2406] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:08.420042 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:08.428138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:08.485066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af23c-ebba-4b5c-ac6b-ddadcfeca109 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:08.489283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:08.489903 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:08.490175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:08.490442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:08.499157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:08.500694 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:08.510019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1201/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:10.765793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:10.765793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:10.766435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:10.787117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:10.788350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:10.817158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:10.863906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1207/2408] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:37:10.889802 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:10.891425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:10.911649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:10.982185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63c65-671b-4c46-9082-84fd1fcbda39 service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:10.988026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:10.988858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:10.989143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:10.989411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:10.998323 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:10.999989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66773a-5bba-482c-86cf-cf0f80102a27 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:11.013280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1202/2409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:14.305312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:14.307131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:14.375093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aea9b-f18c-45df-bddd-0094e3c59dfb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:14.379238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:14.379858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:14.380131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:14.380393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:14.382344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:14.455492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:14.456947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:14.467654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1208/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:16.036961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9641dd-0f59-47d0-865c-e273ea5d8746 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:16.038006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9641dd-0f59-47d0-865c-e273ea5d8746 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:16.038287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9641dd-0f59-47d0-865c-e273ea5d8746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:16.061147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3b9641dd-0f59-47d0-865c-e273ea5d8746 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:16.063116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3b9641dd-0f59-47d0-865c-e273ea5d8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:16.076870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1203/2411] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:16.101384 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:16.102910 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:16.120657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf0c2-f651-44cd-81c8-57dc4c242a19 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:16.127542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:16.128228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:16.128510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:16.128843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:16.138742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:16.140456 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:16.151325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1209/2412] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:20.248170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d11c7-d702-4c6d-8dd6-14bab1d8f232 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:20.249437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d11c7-d702-4c6d-8dd6-14bab1d8f232 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:20.249720 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d11c7-d702-4c6d-8dd6-14bab1d8f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:20.271583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-989d11c7-d702-4c6d-8dd6-14bab1d8f232 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:20.273463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-989d11c7-d702-4c6d-8dd6-14bab1d8f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:20.283553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1204/2413] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:20.305553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:20.317273 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408a91-b89c-4bed-8582-789f7dcbf449 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:20.322944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:20.323593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:20.323870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:20.324136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:20.333297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:20.334973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:20.349187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1210/2414] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:30.265785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=33 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:30.341058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=77 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:37.882283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0123-d9ed-44d4-abf6-c6a6aae0bcb6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:37.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0123-d9ed-44d4-abf6-c6a6aae0bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:37.882876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0123-d9ed-44d4-abf6-c6a6aae0bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:37.908701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c97b0123-d9ed-44d4-abf6-c6a6aae0bcb6 None None] MFA Rules not processed for user `2984e115f4414120a41590ca8d2f9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:37.910225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c97b0123-d9ed-44d4-abf6-c6a6aae0bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:37.974645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1205/2415] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:37:38.172169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:38.182378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042046-bd78-472c-9ffe-6c60de6564f3 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:38.190502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:38.191488 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:38.191764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:38.192037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] PATH_INFO: `/v3/users/7472afa0494640bd9db95cfd8be838ca` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:38.193171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7472afa0494640bd9db95cfd8be838ca)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:38.195405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:38.247417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7472afa0494640bd9db95cfd8be838ca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.248083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7472afa0494640bd9db95cfd8be838ca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.248703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7472afa0494640bd9db95cfd8be838ca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.256797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7472afa0494640bd9db95cfd8be838ca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.270643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7472afa0494640bd9db95cfd8be838ca'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.286022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1211/2416] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:37:38 2022] DELETE /identity/v3/users/7472afa0494640bd9db95cfd8be838ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:38.290292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:38.290580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:38.290853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:38.312739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:38.313998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:38.380253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1206/2417] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:37:38.390287 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:38.392044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:38.454509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea78894-21a3-49a6-836e-c293813724b6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:38.458353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:38.458992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:38.459307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:38.459582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:38.469484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:38.470951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c8f1c-1dca-4998-80e3-e79ed4350763 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:38.482019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1212/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:37:38.831391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:38.831391 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:38.846133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8df9-5662-41b6-9740-18d56bb32fc3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:38.852227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:38.853686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:38.854268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:38.854847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] PATH_INFO: `/v3/projects/1be3d1d670fa4536aab0891eba12ccfd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:38.856236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be3d1d670fa4536aab0891eba12ccfd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:38.859026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:38.934658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be3d1d670fa4536aab0891eba12ccfd', 'request_id': 'req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.944329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be3d1d670fa4536aab0891eba12ccfd', 'request_id': 'req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.959444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be3d1d670fa4536aab0891eba12ccfd', 'request_id': 'req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.977858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] The token cache is being invalidate because project 1be3d1d670fa4536aab0891eba12ccfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:37:38.978153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.979602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee9aa0a-9fd9-4b4b-8ee4-39ffa97cdf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:37:38.981408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1207/2419] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:37:38 2022] DELETE /identity/v3/projects/1be3d1d670fa4536aab0891eba12ccfd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:38.986665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:38.986953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:38.987258 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.012154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:39.013405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:39.098047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1213/2420] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:39.106419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.106691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.106963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.127886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:39.128978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:39.140743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1208/2421] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:39.143447 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.153880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3502-8ad9-442e-a261-89c539bad80e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.159134 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.159849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.160193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.160599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.161345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:37:39.161721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.163431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.179911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1214/2422] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:37:39.184571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.194550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae478989-5ca4-4eaf-9e07-e43dccf332c6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.200405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.200960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.201231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.201492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.202314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.204425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.233646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:39.246774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1209/2423] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:37:39 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:37:39.248861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.255904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:39.265617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9c07f-d563-44b2-824f-580db232396e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.344346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.344976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.345257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.345534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.346180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.348200 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.371812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1215/2424] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:37:39 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:37:39.377586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.388267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11846e-1491-4825-b798-6bd4a1ebae41 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.393117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.393724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.394036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.394307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.394959 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.396605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.407164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1210/2425] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:37:39.411490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.421729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e4ace-3762-4b37-894a-7c479b316465 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.427074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.427738 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.428021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.429892 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.430683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.432558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6167-db92-410b-897f-a160beb3c94c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.447072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1216/2426] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:37:39.452571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.463243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500859-1ad8-40a6-b5a1-1537bad30f91 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.468463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.469119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.469399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.469645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] PATH_INFO: `/v3/projects/9e8ef33283e443c9977d8ffc95e3a393/users/3246cf2876594d3eba5c2b1d503860a8/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.484640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8ef33283e443c9977d8ffc95e3a393, user_id=3246cf2876594d3eba5c2b1d503860a8, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.487318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.503917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1211/2427] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:37:39 2022] PUT /identity/v3/projects/9e8ef33283e443c9977d8ffc95e3a393/users/3246cf2876594d3eba5c2b1d503860a8/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:37:39.518859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35563f4-a8a2-4ed9-87e7-6e678c215916 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.519157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35563f4-a8a2-4ed9-87e7-6e678c215916 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.519469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35563f4-a8a2-4ed9-87e7-6e678c215916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.547931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f35563f4-a8a2-4ed9-87e7-6e678c215916 None None] MFA Rules not processed for user `3246cf2876594d3eba5c2b1d503860a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:39.549160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f35563f4-a8a2-4ed9-87e7-6e678c215916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:39.627106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1217/2428] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:39.639127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:39.640907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:39.705329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee0e1-a3d7-4909-92b0-7fbbaaf4d19b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:39.711505 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:39.712413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:39.712812 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:39.713201 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:39.723909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:39.725328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:39.734311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1212/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:37:49.623591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:49.730204 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:37:57.443787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7434-2736-46fd-9d1e-7dfdec7f33d2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:57.444309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7434-2736-46fd-9d1e-7dfdec7f33d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:57.444413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa7434-2736-46fd-9d1e-7dfdec7f33d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:57.472322 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-94aa7434-2736-46fd-9d1e-7dfdec7f33d2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:37:57.473821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-94aa7434-2736-46fd-9d1e-7dfdec7f33d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:57.545777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1218/2430] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:37:57.568194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:37:57.570109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:37:57.657961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fe11-1ca1-4bcf-8ac1-96a2482bdeea service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:37:57.663793 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:37:57.664382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:37:57.664661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:37:57.664934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:37:57.674973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:37:57.676859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c005-053a-4e8e-8dad-575d5fcfa5dc service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:37:57.688586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1213/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:00.126436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:00.126939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:00.127042 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:00.146869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] MFA Rules not processed for user `26adbd5487f0466d9b36adc4d6f768dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:00.148133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:00.204982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1219/2432] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:00.693022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544934a7-e317-4df9-8bcd-9620f76ef1c2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:00.693921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544934a7-e317-4df9-8bcd-9620f76ef1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:00.694187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544934a7-e317-4df9-8bcd-9620f76ef1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:00.715551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-544934a7-e317-4df9-8bcd-9620f76ef1c2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:00.716757 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-544934a7-e317-4df9-8bcd-9620f76ef1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:00.737698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1214/2433] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:00.859750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:00.865011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:00.883813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6410-a286-4fd0-ba5d-41282bd9c642 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:00.891056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:00.892446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:00.892894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:00.893301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:00.905366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:00.907139 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:00.919023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1220/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:04.469798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b305-6240-49f1-b974-05e9c4165565 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:04.470362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b305-6240-49f1-b974-05e9c4165565 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:04.470362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b305-6240-49f1-b974-05e9c4165565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:04.490137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-55c7b305-6240-49f1-b974-05e9c4165565 None None] MFA Rules not processed for user `cd53375218ec492e8e250efe42b3d09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:04.491404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55c7b305-6240-49f1-b974-05e9c4165565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:04.562051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1215/2435] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:04.809762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:04.820190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:04.820704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:04.821806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:04.822463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e33ed9-33cc-440d-95e9-78d9ca1e2598 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:04.827660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:04.828437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:04.829017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:04.829299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] PATH_INFO: `/v3/users/3246cf2876594d3eba5c2b1d503860a8` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:04.830531 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3246cf2876594d3eba5c2b1d503860a8)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:04.832497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:04.854117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:04.855781 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:04.867745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1216/2436] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:04.891332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:04.901484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3246cf2876594d3eba5c2b1d503860a8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:04.902196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3246cf2876594d3eba5c2b1d503860a8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:04.902825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3246cf2876594d3eba5c2b1d503860a8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:04.905295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab22802-edf4-493f-8ffb-345b484ed3e3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:04.911639 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d73022-20e5-466c-81ed-080603df878a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:04.912256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73022-20e5-466c-81ed-080603df878a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:04.912703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73022-20e5-466c-81ed-080603df878a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:04.912831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3246cf2876594d3eba5c2b1d503860a8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:04.912968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73022-20e5-466c-81ed-080603df878a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:04.914948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89d73022-20e5-466c-81ed-080603df878a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:04.927683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d9c5f6b4-1b33-4387-9913-d6891e1b395d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3246cf2876594d3eba5c2b1d503860a8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:04.937169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d73022-20e5-466c-81ed-080603df878a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:04.947100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1221/2437] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:38:04 2022] DELETE /identity/v3/users/3246cf2876594d3eba5c2b1d503860a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:04.951277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d73022-20e5-466c-81ed-080603df878a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:04.952685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:04.953828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:04.954311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:04.965257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:04.973288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1217/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:04.982773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:04.985540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:05.060102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1222/2439] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:38:05.076976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d73022-20e5-466c-81ed-080603df878a service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:05.078852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89d73022-20e5-466c-81ed-080603df878a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:05.187301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d73022-20e5-466c-81ed-080603df878a service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:05.206742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:05.241684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:05.242641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.242641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.242867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.252164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:05.253605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3ba63-8624-4c43-be25-dda61bd1b2df service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:05.263438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1218/2440] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:05.591499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:05.592994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:05.605830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e663bf-748a-499e-bfc5-1bee3229649c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:05.611209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:05.611921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.612196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.612776 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] PATH_INFO: `/v3/projects/9e8ef33283e443c9977d8ffc95e3a393` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.614331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8ef33283e443c9977d8ffc95e3a393)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:05.616303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:05.664758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8ef33283e443c9977d8ffc95e3a393', 'request_id': 'req-6e21cc87-2933-4b88-97c8-d1800f220369'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:05.670989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8ef33283e443c9977d8ffc95e3a393', 'request_id': 'req-6e21cc87-2933-4b88-97c8-d1800f220369'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:05.679987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8ef33283e443c9977d8ffc95e3a393', 'request_id': 'req-6e21cc87-2933-4b88-97c8-d1800f220369'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:05.691768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] The token cache is being invalidate because project 9e8ef33283e443c9977d8ffc95e3a393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:38:05.691768 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:05.693137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6e21cc87-2933-4b88-97c8-d1800f220369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:05.693895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1223/2441] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:38:05 2022] DELETE /identity/v3/projects/9e8ef33283e443c9977d8ffc95e3a393 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:05.698907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.699467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.699467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.719988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:05.721298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:05.780143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1219/2442] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:05.788046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.788333 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.788609 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.812180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:05.813395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:05.822400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1224/2443] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:05.826845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:05.837046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059508-9e2a-4a3a-870d-efbf56c07ba3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:05.842048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:05.842665 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.842939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.843228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.843964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:38:05.844305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:05.845897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:05.858065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1220/2444] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:38:05.862399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:05.872842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb56f23-e8b5-404e-b015-84a19dd6b982 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:05.879663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:05.880440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.880807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.881169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.881897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:05.883945 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:05.917253 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1225/2445] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:38:05 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:38:05.920114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:05.930461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05d55-4099-4623-8ed3-58f5c85707f6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:05.996415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:05.997029 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:05.997302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:05.997571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:05.998175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:06.000151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:06.023863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1221/2446] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:38:05 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:38:06.031135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:06.043701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e0ef5-db41-43e5-94ff-869e71980efe admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:06.049209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:06.050002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:06.050375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:06.050744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:06.051556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:06.053428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:06.067971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1226/2447] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:38:06.071112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:06.082006 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805cb6a-07fb-4b57-969f-0f464b876311 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:06.087478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:06.088100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:06.088376 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:06.088635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:06.089293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:06.091228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0d5c0-f86d-4e24-81ec-4d5e40b06203 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:06.107021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1222/2448] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:38:06.108435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:06.119054 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e71a-9f9a-4c71-a339-34b0f9330668 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:06.124290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:06.124964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:06.125239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:06.125615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] PATH_INFO: `/v3/projects/1bfcec6b8f784e05afe2ca6b6d3a279d/users/7dcd0d2734e34ad8be6971770b8687c1/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:06.141070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfcec6b8f784e05afe2ca6b6d3a279d, user_id=7dcd0d2734e34ad8be6971770b8687c1, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:06.143751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:06.160740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1227/2449] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:38:06 2022] PUT /identity/v3/projects/1bfcec6b8f784e05afe2ca6b6d3a279d/users/7dcd0d2734e34ad8be6971770b8687c1/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:06.171314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637748-4b12-4848-bb9e-6626eace0e8c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:06.171811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637748-4b12-4848-bb9e-6626eace0e8c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:06.172131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637748-4b12-4848-bb9e-6626eace0e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:06.203104 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-17637748-4b12-4848-bb9e-6626eace0e8c None None] MFA Rules not processed for user `7dcd0d2734e34ad8be6971770b8687c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:06.204469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-17637748-4b12-4848-bb9e-6626eace0e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:06.225097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:06.277512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1223/2450] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:06.288785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:06.290524 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:06.318409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:06.351252 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973d8bb-d7ba-434d-a4b0-5e3790a57ff0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:06.355438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:06.356069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:06.356341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:06.356612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:06.365429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:06.366926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:06.376402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1228/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:08.085344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10c16-bc9f-4a8f-855c-1201c44ceaa5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:08.085344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10c16-bc9f-4a8f-855c-1201c44ceaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:08.085344 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10c16-bc9f-4a8f-855c-1201c44ceaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:08.097707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7ac10c16-bc9f-4a8f-855c-1201c44ceaa5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:08.098852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ac10c16-bc9f-4a8f-855c-1201c44ceaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:08.168096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1224/2452] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:08.192826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:08.194504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:08.273915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066957-999c-4348-8e58-6d07b94fe3e5 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:08.279713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:08.280352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:08.280632 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:08.280905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:08.290866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:08.292623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:08.311847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1229/2453] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:13.307384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:13.308045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:13.308045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:13.338970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:13.340247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:13.352395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1225/2454] 10.222.0.44 () {58 vars in 1016 bytes} [Sun Aug 7 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:13.378996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:13.382573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:13.399562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e29519-dcf9-4290-8e09-60714f2a0cb9 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:13.405164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:13.405758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:13.406033 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:13.406299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:13.415951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:13.417912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eff9af-c479-4a8b-8cd2-f5347d672dce service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:13.438909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1230/2455] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:23.332178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=49 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:23.425142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=55 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:39.997998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:40.008328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f64d-d9a6-4335-8aee-cad553cdc9fd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:40.014461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:40.015235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.015471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.015749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] PATH_INFO: `/v3/users/7dcd0d2734e34ad8be6971770b8687c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.017060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcd0d2734e34ad8be6971770b8687c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:40.018954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:40.075297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcd0d2734e34ad8be6971770b8687c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.075966 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcd0d2734e34ad8be6971770b8687c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.076580 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcd0d2734e34ad8be6971770b8687c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.088458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcd0d2734e34ad8be6971770b8687c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.095575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcd0d2734e34ad8be6971770b8687c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.109991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1226/2456] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:38:39 2022] DELETE /identity/v3/users/7dcd0d2734e34ad8be6971770b8687c1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:40.114824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.115364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.115590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.136800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:40.138041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:40.202779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1231/2457] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:38:40.215985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:40.217641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:40.286350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529332b-a872-4d76-bcc1-f860d9f3f323 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:40.292380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:40.292380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.292380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.292380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.309884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:40.312146 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84f4e9-acfc-425f-bdd6-f49217656244 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:40.327043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1227/2458] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:40.658149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:40.659882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:40.683397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c7135-79cb-47d6-b8ff-9f02b22b26f9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:40.693992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:40.694845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.695119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.695495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] PATH_INFO: `/v3/projects/1bfcec6b8f784e05afe2ca6b6d3a279d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.696755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfcec6b8f784e05afe2ca6b6d3a279d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:40.698827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:40.750672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfcec6b8f784e05afe2ca6b6d3a279d', 'request_id': 'req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.757400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfcec6b8f784e05afe2ca6b6d3a279d', 'request_id': 'req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.766580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfcec6b8f784e05afe2ca6b6d3a279d', 'request_id': 'req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.778532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] The token cache is being invalidate because project 1bfcec6b8f784e05afe2ca6b6d3a279d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:38:40.778880 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.779676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bb7fb22c-4a8e-40bc-b0dd-a01807e7a57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:40.781427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1232/2459] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:38:40 2022] DELETE /identity/v3/projects/1bfcec6b8f784e05afe2ca6b6d3a279d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:40.786322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.786609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.786877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.807974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:40.809200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:40.877588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1228/2460] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:38:40.946869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:40.947144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:40.947489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:40.970652 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:40.971927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:40.980294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1233/2461] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:38:40.984886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:40.996591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659e81-b07d-4678-a719-fc9863cf6728 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.002439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.003127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.003364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.003655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.004303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:38:41.004620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.006241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.019821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1229/2462] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:38:41.024550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.034919 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa98a-f4fa-4050-84df-226b2c7af816 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.040172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.040810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.041093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.041372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.042014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.044018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.078585 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1234/2463] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:38:41 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:38:41.082997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.088252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:41.096214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08450ac-c763-439d-91ed-4cb008062c64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.159972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.160549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.160833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.161105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.161746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.163715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.191540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1230/2464] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:38:41 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:38:41.197219 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.208083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786acb-4674-4f07-86b8-a90ed334a1fb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.213332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.213940 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.214213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.214482 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.215136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.216756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.227263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1235/2465] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:38:41.231730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.242542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8901-0f21-4972-a6f6-95132ba98b6b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.248285 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.248888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.249170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.249477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.250128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.251771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17a58-afee-433a-90da-82d7be87c6a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.263330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1231/2466] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:38:41.268477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.279147 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7c12b-f74b-4d09-9b2f-e84121a3e332 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.285037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.285642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.285931 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.286218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] PATH_INFO: `/v3/projects/9c6a82c0aec14820bf1f68e35247b7dc/users/ff4010b7582d4c6ab8c3bb3e78405132/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.301189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6a82c0aec14820bf1f68e35247b7dc, user_id=ff4010b7582d4c6ab8c3bb3e78405132, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.303878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.318751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1236/2467] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:38:41 2022] PUT /identity/v3/projects/9c6a82c0aec14820bf1f68e35247b7dc/users/ff4010b7582d4c6ab8c3bb3e78405132/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:41.329172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.329289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.329565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.358588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] MFA Rules not processed for user `ff4010b7582d4c6ab8c3bb3e78405132`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:41.359918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:41.428593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1232/2468] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:38:41.440434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:41.442735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:41.463988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:41.500630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5be98a-04bc-45c8-bd3c-5ee742ed699a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:41.504528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:41.505140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:41.505415 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:41.505687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:41.514119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:41.515626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:41.524502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1237/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:45.500162 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:45.501893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:45.578365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737e6ed-248a-4d54-868e-0cfbbff6a6e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:45.584663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:45.585317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:45.585664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:45.585863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] PATH_INFO: `/v3/users/2984e115f4414120a41590ca8d2f9da3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:45.587076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2984e115f4414120a41590ca8d2f9da3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:45.589138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:45.603807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:45.640437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2984e115f4414120a41590ca8d2f9da3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:45.641075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2984e115f4414120a41590ca8d2f9da3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:45.641675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2984e115f4414120a41590ca8d2f9da3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:45.653484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2984e115f4414120a41590ca8d2f9da3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:45.660230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2984e115f4414120a41590ca8d2f9da3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:45.674874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1233/2470] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:38:45 2022] DELETE /identity/v3/users/2984e115f4414120a41590ca8d2f9da3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:38:45.863979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:45.876155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fc6e-67ab-425f-ae51-08c79cecf881 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:45.948321 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:45.948975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:45.949876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:45.950154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] PATH_INFO: `/v3/projects/f4d06ef6b30b48c1a7b3ff89d4e1a3f3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:45.951326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d06ef6b30b48c1a7b3ff89d4e1a3f3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:45.953265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:46.004750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d06ef6b30b48c1a7b3ff89d4e1a3f3', 'request_id': 'req-344a3250-ded0-414e-87ae-e963826cf129'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:46.012547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d06ef6b30b48c1a7b3ff89d4e1a3f3', 'request_id': 'req-344a3250-ded0-414e-87ae-e963826cf129'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:46.029812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d06ef6b30b48c1a7b3ff89d4e1a3f3', 'request_id': 'req-344a3250-ded0-414e-87ae-e963826cf129'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:46.047432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] The token cache is being invalidate because project f4d06ef6b30b48c1a7b3ff89d4e1a3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:38:46.047850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:46.048509 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-344a3250-ded0-414e-87ae-e963826cf129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:46.050525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1238/2471] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:38:45 2022] DELETE /identity/v3/projects/f4d06ef6b30b48c1a7b3ff89d4e1a3f3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:51.652686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:51.654378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:51.674295 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2353-c752-45b2-a77f-d8fb3e6d3bdf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:51.738948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:51.739657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:51.739897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:51.740165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] PATH_INFO: `/v3/users/ff4010b7582d4c6ab8c3bb3e78405132` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:51.741515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4010b7582d4c6ab8c3bb3e78405132)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:51.743501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:51.797584 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4010b7582d4c6ab8c3bb3e78405132'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:51.798245 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4010b7582d4c6ab8c3bb3e78405132'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:51.798863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4010b7582d4c6ab8c3bb3e78405132'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:51.812425 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4010b7582d4c6ab8c3bb3e78405132'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:51.819294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4010b7582d4c6ab8c3bb3e78405132'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:51.833089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1234/2472] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:38:51 2022] DELETE /identity/v3/users/ff4010b7582d4c6ab8c3bb3e78405132 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:38:51.837847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:51.838345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:51.838445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:51.857862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:38:51.859065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:51.916092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:51.931000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1239/2473] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:38:51.941508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:51.943208 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:51.954766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:38:52.011804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a58bc8-3e5b-4ca9-b376-ede7b32685c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:52.016142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:52.016763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:52.017041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:52.017300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:52.028115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:52.029570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:52.040115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1235/2474] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:38:52.325859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:38:52.327439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:38:52.342285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c196-9375-4354-9c9b-f6ead2b59eb5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:38:52.347803 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:38:52.348596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:38:52.348771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:38:52.349039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] PATH_INFO: `/v3/projects/9c6a82c0aec14820bf1f68e35247b7dc` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:38:52.350210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6a82c0aec14820bf1f68e35247b7dc)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:38:52.352133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:38:52.400403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6a82c0aec14820bf1f68e35247b7dc', 'request_id': 'req-8abf8ac8-5053-48b2-92e5-06f85f8751f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:52.406823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6a82c0aec14820bf1f68e35247b7dc', 'request_id': 'req-8abf8ac8-5053-48b2-92e5-06f85f8751f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:52.416286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6a82c0aec14820bf1f68e35247b7dc', 'request_id': 'req-8abf8ac8-5053-48b2-92e5-06f85f8751f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:52.428107 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] The token cache is being invalidate because project 9c6a82c0aec14820bf1f68e35247b7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:38:52.428393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:52.429059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:38:52.430598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1240/2475] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:38:52 2022] DELETE /identity/v3/projects/9c6a82c0aec14820bf1f68e35247b7dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:00.022827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:00.024475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:00.091623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185404-f3e3-4898-85eb-1ce8ae4ce15d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:00.150583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:00.151214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:00.151506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:00.151766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:00.153893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:00.218996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:00.220485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:00.230601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1236/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:00.365690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:00.367967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:00.387449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8ac8-5053-48b2-92e5-06f85f8751f4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:00.392243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:00.392865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:00.393149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:00.393418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:00.395441 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:00.475063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:00.476557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:00.488767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1241/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:03.186136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:03.188097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:03.215666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:03.251893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db81bf-bb8a-4083-9d5f-4671a9264512 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:03.258240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:03.258862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:03.259140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:03.259452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:03.261454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:03.275909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:03.277334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:03.288797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1237/2478] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:10.482968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:12.572471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:12.574481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:12.593461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f10f7-2f18-40ec-aac0-feba5ae16381 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:12.600591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:12.601192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:12.601465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:12.601740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:12.603847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:12.672192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:12.673829 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:12.684171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1242/2479] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:13.283803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=16 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:18.357696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:18.372140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ab698-4a2e-45d2-9567-f36bd6e8ae81 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:18.378693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:18.379814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:18.380318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:18.380886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:18.383234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:18.399961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:18.404234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b2b3-4214-4246-80e5-74907b908040 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:18.416803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1238/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:22.334168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:22.345326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9fa7-8a8f-4426-8358-888e237755bf service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:22.350718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:22.351718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:22.352019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:22.352391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:22.354226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:22.365795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:22.367674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:22.376916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1243/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:25.215086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:25.215871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:25.215871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:25.236870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] MFA Rules not processed for user `525edac979aa45e3adb880f99dfb3345`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:25.238105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:25.298232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1239/2482] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:25.698185 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:25.710664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5c00-269a-4902-9479-6a4de3d5a88f service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:25.714717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:25.715501 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:25.715883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:25.716157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:25.729800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:25.743266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:25.745035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fac5b0-806c-423a-bfc4-55e63e220d9d service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:25.767411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1244/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:26.112952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:26.114462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:26.185925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52e8a6-f5bc-4de8-b03c-5b0f1199ec30 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:26.191362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:26.191994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:26.192266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:26.192538 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:26.194298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:26.206109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:26.207744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a32bd-fce0-484e-b235-e5b900b518a1 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:26.219184 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1240/2484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:26.797116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:26.797732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:26.797732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:26.799171 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1245/2485] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 19:39:26.805625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:26.805912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:26.806359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:26.834378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] MFA Rules not processed for user `ec7f568319844b9fbd05f7936d439b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:26.835938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:26.844305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1241/2486] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:26.860115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:26.864312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:26.882396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9eb9f-47ab-4265-a00e-6680f32f7279 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:26.888119 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:26.888966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:26.889245 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:26.889674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:26.898480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:26.900595 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31c754-6791-4fe7-be70-bde92f9f18b4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:26.910561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1246/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:26.921875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:26.932222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3ff94-84ff-4240-a33d-fe87271ab844 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:26.936154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:26.937440 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:26.937722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:26.937995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:26.939753 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:27.006741 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:27.008230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:27.012223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e8c2-52eb-4cd8-a5fb-aa5ca2c376e2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:27.012511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e8c2-52eb-4cd8-a5fb-aa5ca2c376e2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:27.012811 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5e8c2-52eb-4cd8-a5fb-aa5ca2c376e2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:27.014154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1247/2488] 10.222.0.15 () {54 vars in 921 bytes} [Sun Aug 7 19:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 19:39:27.019050 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1242/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:27.019403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:27.019692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:27.019967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:27.040507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] MFA Rules not processed for user `31fcd522972b4af7ab786a11af6938f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:27.041746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:27.051900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1248/2490] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Aug 7 19:39:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:27.063725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:27.072955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9d7df-cc53-4fec-9385-baddaf7c14e5 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:27.077583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:27.078263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:27.078539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:27.078800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:27.087953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:27.090715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:27.092408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:27.104417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1243/2491] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:39:27.942492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:27.945894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:27.977453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6e38-ee8b-4f0c-99e8-cbc08503c015 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:27.995930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:27.996848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:27.997402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:27.997898 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:28.001775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:28.019243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:28.022670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:28.039110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1249/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:33.224083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:33.244739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c39d-cc35-4450-96ef-0bb625483c6e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:33.252213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:33.253256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:33.254191 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:33.254811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:33.256917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:33.273905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:33.275857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:33.289404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1244/2493] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:33.365831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:33.367454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:33.382466 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc45bf-53e4-42eb-b05e-35ab917cd202 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:33.386879 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:33.387547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:33.387820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:33.388087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] PATH_INFO: `/v3/users/cd53375218ec492e8e250efe42b3d09c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:33.389193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd53375218ec492e8e250efe42b3d09c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:33.392084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:33.450827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd53375218ec492e8e250efe42b3d09c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.452096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd53375218ec492e8e250efe42b3d09c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.453173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd53375218ec492e8e250efe42b3d09c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.461748 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd53375218ec492e8e250efe42b3d09c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.475311 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dafe110d-4196-4359-9d8d-88ad7ea0a014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd53375218ec492e8e250efe42b3d09c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.489741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1250/2494] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:33 2022] DELETE /identity/v3/users/cd53375218ec492e8e250efe42b3d09c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:33.749351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:33.777099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5c7fb-b2f7-4bb3-b647-00feb8ac9759 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:33.856443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:33.857109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:33.857388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:33.857656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] PATH_INFO: `/v3/projects/d472b7dc4b5e4f808bee80715c2f29f7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:33.859530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d472b7dc4b5e4f808bee80715c2f29f7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:33.862987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:33.928730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd472b7dc4b5e4f808bee80715c2f29f7', 'request_id': 'req-b7b9a631-bf4d-470e-94eb-c329fc26adf8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.936495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd472b7dc4b5e4f808bee80715c2f29f7', 'request_id': 'req-b7b9a631-bf4d-470e-94eb-c329fc26adf8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.949461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd472b7dc4b5e4f808bee80715c2f29f7', 'request_id': 'req-b7b9a631-bf4d-470e-94eb-c329fc26adf8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.962658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] The token cache is being invalidate because project d472b7dc4b5e4f808bee80715c2f29f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:33.962943 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.963939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b7b9a631-bf4d-470e-94eb-c329fc26adf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:33.965482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1245/2495] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:33 2022] DELETE /identity/v3/projects/d472b7dc4b5e4f808bee80715c2f29f7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:33.974915 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:33.975599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:33.976352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.007020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:34.008567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:34.014457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:34.076369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1251/2496] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:34.085417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.086389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.087065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.112238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:34.113992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:34.123936 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1246/2497] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:34.128330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.155745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1ddcd-51b1-4073-9b01-e98edbf6acfb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.169807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.170520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.170986 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.171347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.172097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:34.172603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.174484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.188362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1252/2498] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:34.193063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.202482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8024a-c872-4028-847f-d346bb4e0d44 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.207392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.207995 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.208272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.208541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.209174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.211181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.241732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1247/2499] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:39:34.247034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.258143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edca2c-b5bd-445f-a038-888fe0612785 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.331928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.332733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.333079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.333370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.334006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.336250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.359797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1253/2500] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:34.363752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.374471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1b8f4-51e0-4d5a-900a-74c37a1815c2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.379479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.380091 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.380367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.380634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.381317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.382920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.393094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1248/2501] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:34.397269 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.407539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ac96a-971a-482c-89ed-31b22822b020 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.412428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.413055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.413330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.413600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.414255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.415907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61683ad-d34f-4abe-bdaf-87aa8555b61c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.432429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1254/2502] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:34.437795 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.448242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662af53-cad7-46ac-9c96-24c6d5985ba9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.453003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.453666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.453928 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.454192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] PATH_INFO: `/v3/projects/0d765b56d60b4aebaadb39ddb401b452/users/be043c06dd124a42b447f8934bb91e63/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.477961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d765b56d60b4aebaadb39ddb401b452, user_id=be043c06dd124a42b447f8934bb91e63, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.481165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.499165 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1249/2503] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:34 2022] PUT /identity/v3/projects/0d765b56d60b4aebaadb39ddb401b452/users/be043c06dd124a42b447f8934bb91e63/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:34.509942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.510361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.510766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.549991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] MFA Rules not processed for user `be043c06dd124a42b447f8934bb91e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:34.551648 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:34.639557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1255/2504] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:34.644107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.654760 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:34.714512 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51925-e75f-4c21-9b43-1bf9514bf140 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.720073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.720682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.720955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.721223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.721840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.723777 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.755456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1250/2505] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:34.756726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.768062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790dc8-1db1-4658-aae2-0b0ac9b61b2d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.772036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:34.833586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.834453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.834625 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.834906 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.835546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.837728 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.861951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1256/2506] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:34 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:34.868122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.880471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355df06-aa5e-4f5f-8826-8e20bc78b7c1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.886205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.886854 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.887134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.887467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.888127 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.889866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.900991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1251/2507] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:34.905500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.916404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38287887-b53d-4521-a4c2-f121e9311669 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:34.922377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:34.923035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:34.923344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:34.923626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] PATH_INFO: `/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e/users/52aaba6878924546a15c83e206610087/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:34.940705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a7169b4bfb4bdc84cb0e35fefb717e, user_id=52aaba6878924546a15c83e206610087, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:34.943436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:34.958661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1257/2508] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:34 2022] PUT /identity/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e/users/52aaba6878924546a15c83e206610087/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:34.962766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:34.973157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc80725-4c09-4bf4-8cb8-dcf400477313 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.063756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.064981 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.065272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.065548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.066581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.068424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd0a7b-c8a8-4d3c-a109-c527b22285cd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.086122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1252/2509] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:35.087380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.098535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661ed36-329a-4c5d-88d0-672c07418753 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.103810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.104528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.104809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.105084 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] PATH_INFO: `/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e/users/52aaba6878924546a15c83e206610087/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.107056 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a7169b4bfb4bdc84cb0e35fefb717e, user_id=52aaba6878924546a15c83e206610087, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.110062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.127264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1258/2510] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:35 2022] PUT /identity/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e/users/52aaba6878924546a15c83e206610087/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:35.135268 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.135556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.135835 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.168133 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] MFA Rules not processed for user `52aaba6878924546a15c83e206610087`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:35.170600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:35.255048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1253/2511] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:35.270210 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.272050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:35.342026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a4ab-2276-41fc-b22f-9c7ac5aabec1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.347489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.348427 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.348715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.349030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.362601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.363997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.391316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1259/2512] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:35.735408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.741197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:35.745164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ac8f5-91cb-47d2-b666-4ecdbbb67b0f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.751865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aaba6878924546a15c83e206610087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33a7169b4bfb4bdc84cb0e35fefb717e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.752605 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.752893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.753167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.753857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:35.754160 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.755813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.768540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1254/2513] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:35.772946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.782661 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9805-d955-41e1-8f29-b2b66f26d1b1 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.787749 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aaba6878924546a15c83e206610087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33a7169b4bfb4bdc84cb0e35fefb717e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.788375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.788653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.788918 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.789539 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.791540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.826903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1260/2514] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:35 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:35.831225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.841591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02bf7-9c89-4ada-be65-b326f5115913 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.899539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aaba6878924546a15c83e206610087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33a7169b4bfb4bdc84cb0e35fefb717e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.900158 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.900438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.900712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.901365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:35.901672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.903277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:35.916164 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1255/2515] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:35.955332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:35.966154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74160e-e748-4e7a-b4f9-2c3e7b3b9c69 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:35.971145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aaba6878924546a15c83e206610087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33a7169b4bfb4bdc84cb0e35fefb717e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:35.971820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:35.972097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:35.972364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] PATH_INFO: `/v3/projects/80f5591511014762844c6f873c6e1e90` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:35.973496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80f5591511014762844c6f873c6e1e90)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:35.975439 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:36.014547 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:36.025946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f5591511014762844c6f873c6e1e90', 'request_id': 'req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.037908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f5591511014762844c6f873c6e1e90', 'request_id': 'req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.047327 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f5591511014762844c6f873c6e1e90', 'request_id': 'req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.057902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] The token cache is being invalidate because project 80f5591511014762844c6f873c6e1e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:36.058186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.058821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4c3c84e9-1664-490a-bb3c-ab3b10fc5f98 tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.060366 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1261/2516] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:35 2022] DELETE /identity/v3/projects/80f5591511014762844c6f873c6e1e90 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:36.281024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:36.283060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:36.353035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4747df-3524-4ee3-9c76-af9d3cf694fc tempest-VolumeQuotaClassesTest-2020808787 tempest-VolumeQuotaClassesTest-2020808787-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:36.412341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:36.412992 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:36.413272 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:36.413569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] PATH_INFO: `/v3/users/be043c06dd124a42b447f8934bb91e63` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:36.414719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be043c06dd124a42b447f8934bb91e63)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:36.416678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:36.464544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:36.491692 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be043c06dd124a42b447f8934bb91e63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.492558 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be043c06dd124a42b447f8934bb91e63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.493275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be043c06dd124a42b447f8934bb91e63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.513698 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be043c06dd124a42b447f8934bb91e63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.523657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be043c06dd124a42b447f8934bb91e63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:36.545237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1256/2517] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:36 2022] DELETE /identity/v3/users/be043c06dd124a42b447f8934bb91e63 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:36.547179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:36.547520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:36.547821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:36.579853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:36.582593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:36.686202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1262/2518] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:36.704417 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:36.706018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:36.707237 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:36.709944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:36.772893 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ec110-a746-4697-8b30-bb0443c224ad None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:36.776788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:36.777517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:36.777828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:36.778165 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:36.789132 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:36.790207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:36.793939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83a5c-7e8c-4c5e-82a1-4b773401fe50 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:36.800083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:36.801090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:36.801214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1263/2519] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:36.801327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:36.801569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:36.804055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:36.817985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:36.819814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:36.832560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1257/2520] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:37.127378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:37.128849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:37.142184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bf401-5760-4b83-b2cf-2a2da89cbc44 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:37.147761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:37.148312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:37.148688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:37.148896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] PATH_INFO: `/v3/projects/0d765b56d60b4aebaadb39ddb401b452` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:37.150073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d765b56d60b4aebaadb39ddb401b452)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:37.152058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:37.221813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d765b56d60b4aebaadb39ddb401b452', 'request_id': 'req-44a34cd8-12df-4adb-b168-706f6d177e00'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.229186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d765b56d60b4aebaadb39ddb401b452', 'request_id': 'req-44a34cd8-12df-4adb-b168-706f6d177e00'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.240999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d765b56d60b4aebaadb39ddb401b452', 'request_id': 'req-44a34cd8-12df-4adb-b168-706f6d177e00'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.243457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:37.260608 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] The token cache is being invalidate because project 0d765b56d60b4aebaadb39ddb401b452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:37.260899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.261557 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44a34cd8-12df-4adb-b168-706f6d177e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.263345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1264/2521] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:37 2022] DELETE /identity/v3/projects/0d765b56d60b4aebaadb39ddb401b452 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:37.267327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:37.282441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337c41b-3706-4130-a7e3-9ffe5ab1a50f service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:37.339397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:37.340027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:37.340302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:37.340568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] PATH_INFO: `/v3/users/52aaba6878924546a15c83e206610087` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:37.341662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52aaba6878924546a15c83e206610087)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:37.343680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:37.397003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:37.413590 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52aaba6878924546a15c83e206610087'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.414657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52aaba6878924546a15c83e206610087'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.415922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52aaba6878924546a15c83e206610087'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.446467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52aaba6878924546a15c83e206610087'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.457450 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52aaba6878924546a15c83e206610087'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:37.477573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1258/2522] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:37 2022] DELETE /identity/v3/users/52aaba6878924546a15c83e206610087 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:37.824308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:37.824911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:37.825224 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:37.865767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:37.867318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:37.912228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:37.913938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:37.995889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1265/2523] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:38.049680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.052082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:38.072075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eb6b3-a37a-4017-872f-7191ad135de3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.079356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.080307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.080685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.081093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] PATH_INFO: `/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.082481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a7169b4bfb4bdc84cb0e35fefb717e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.085156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.137073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a7169b4bfb4bdc84cb0e35fefb717e', 'request_id': 'req-3998453b-5861-48c3-88d1-89be100cbfed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:38.149035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a7169b4bfb4bdc84cb0e35fefb717e', 'request_id': 'req-3998453b-5861-48c3-88d1-89be100cbfed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:38.157221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16976167-788e-4b87-9901-e54e78a8f3f1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.160028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a7169b4bfb4bdc84cb0e35fefb717e', 'request_id': 'req-3998453b-5861-48c3-88d1-89be100cbfed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:38.174700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] The token cache is being invalidate because project 33a7169b4bfb4bdc84cb0e35fefb717e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:38.175148 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:38.175881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3998453b-5861-48c3-88d1-89be100cbfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:38.177501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1259/2524] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:37 2022] DELETE /identity/v3/projects/33a7169b4bfb4bdc84cb0e35fefb717e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:39:38.182275 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2aeae-dd86-42bb-bdea-ae5e1d9775a7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.182556 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2aeae-dd86-42bb-bdea-ae5e1d9775a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.182832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2aeae-dd86-42bb-bdea-ae5e1d9775a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.202985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f2e2aeae-dd86-42bb-bdea-ae5e1d9775a7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:38.204194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f2e2aeae-dd86-42bb-bdea-ae5e1d9775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:38.221831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.222389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.222666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.222941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.224731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:38.247956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:38.267142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:38.272963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1260/2525] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:38.280618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.280931 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.281827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.299220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.301235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.305715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:38.307554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:38.311293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1266/2526] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 19:39:38.322821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1261/2527] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:38.324659 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.362951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d345-e194-4495-9ab8-3c9f4839097b service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.369397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.370049 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.370330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.370602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.371544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:38.372005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.373655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.411772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1267/2528] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:38.416053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.444486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716e6e-4cdc-4d61-85c4-de9ea59b4607 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.460557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.461674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.462099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.463026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.463900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.468395 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.525768 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1262/2529] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:38.529004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.548895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4934d-65a2-4a5a-8bb1-282116d0065a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.651024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.652213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.652213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.652423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.653668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.656406 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.686274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1268/2530] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:38.692754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.707715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a94d-cc96-46af-8b65-75cf414bd932 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.715866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.716518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.716801 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.717076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.718740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.720882 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.737106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1263/2531] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:38.740999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.755172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f734-c7f8-41ad-a3f7-4e63097b1292 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.760790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.761516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.761851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.762186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.762969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.764712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d226b-a3c7-49fc-ad7d-6b89dba3a818 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.777036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1269/2532] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:38.781700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:38.792894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773566cf-ae37-425d-bdc1-566683b4d25f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:38.797805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:38.798571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.798906 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.799270 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] PATH_INFO: `/v3/projects/2948ec9f9b3043549cc08c5ca7715977/users/3f0bf7f8ae8b4ce38a9dcaf9c561e366/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.817090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2948ec9f9b3043549cc08c5ca7715977, user_id=3f0bf7f8ae8b4ce38a9dcaf9c561e366, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:38.819926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:38.848372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1264/2533] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:38 2022] PUT /identity/v3/projects/2948ec9f9b3043549cc08c5ca7715977/users/3f0bf7f8ae8b4ce38a9dcaf9c561e366/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:38.850742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:38.851421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:38.851421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:38.882282 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] MFA Rules not processed for user `3f0bf7f8ae8b4ce38a9dcaf9c561e366`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:38.886536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:38.969351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1270/2534] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:38.970214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.054540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95f72-de32-4ef2-996a-cd33b80902ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.059679 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.060308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.060591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.060865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.061673 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.064065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea237-d3d0-42bb-96e5-4ca7eede91d6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.124622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1265/2535] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:38 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:39:39.127047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.144795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6a206-035d-4796-af97-7d09836f3c0a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.225831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.226571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.227103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.267106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:39.271601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:39.280393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:39.321260 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.322773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.327991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.328296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.329573 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.332835 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.398037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1271/2536] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:39 2022] POST /identity/v3/users => generated 303 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:39.401732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.410563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1266/2537] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:39:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:39.413451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983ebe-2fb0-44c5-b9b9-cacb2cbc2874 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.418874 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.419631 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.420129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.420459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.420847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.422508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.435900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.438012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:39.441345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1272/2538] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:39:39.445230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.455678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b70fa-008b-4f85-a240-1bc268ba7ad2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.458262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:39.462712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.463435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.463701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.463974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] PATH_INFO: `/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5/users/2f220d58718941cd87a5e853bff87e61/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.484421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724ec681a2a34b6a8f3913503e4ccbc5, user_id=2f220d58718941cd87a5e853bff87e61, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.489485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.506800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1273/2539] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:39 2022] PUT /identity/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5/users/2f220d58718941cd87a5e853bff87e61/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:39:39.510882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.539658 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ffec0-97bd-4686-b4a1-2616532ab781 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.594926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b00f3-93da-4d9a-a177-bb2b016b38a2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.600503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.601352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.601720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.602127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.602887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.605976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.623178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1274/2540] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:39.624559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.625568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.626399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.626536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.627259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.637149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25eba3-acf7-45e4-9d67-e1839695cc05 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.642306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:39.643097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.643460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.643903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] PATH_INFO: `/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5/users/2f220d58718941cd87a5e853bff87e61/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.646360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724ec681a2a34b6a8f3913503e4ccbc5, user_id=2f220d58718941cd87a5e853bff87e61, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.649262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30eefa-120e-4c03-8402-b0d75d4dadd6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.666374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1275/2541] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:39 2022] PUT /identity/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5/users/2f220d58718941cd87a5e853bff87e61/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:39.680830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:39.681690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:39.682045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:39.722046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:39.724342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:39.730429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] MFA Rules not processed for user `2f220d58718941cd87a5e853bff87e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:39.733168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:39.741656 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1267/2542] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 19:39:39.823173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:39.837551 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1276/2543] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:39.848397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:39.850020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:39.939047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ff06-e3ac-4595-86d7-84b0bd850860 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:39.951331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:40.010447 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:40.011481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:40.011999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:40.012460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:40.024683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:40.026663 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:40.042413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1268/2544] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:40.097515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:40.099087 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:40.111801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1678-8c2d-4804-9b22-6a67350f54c7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:40.115561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:40.116193 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:40.116478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:40.116817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:40.195077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:40.196804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037b058-1e2f-41fe-810f-3d744f2f125b service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:40.208192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1277/2545] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:44.668225 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:44.861710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15219a-c874-446a-adad-f5bc0483395f service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:44.875549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:44.877121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:44.877594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:44.878020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] PATH_INFO: `/v3/users/3f0bf7f8ae8b4ce38a9dcaf9c561e366` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:44.879723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0bf7f8ae8b4ce38a9dcaf9c561e366)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:44.882297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:45.050318 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0bf7f8ae8b4ce38a9dcaf9c561e366'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:45.051542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0bf7f8ae8b4ce38a9dcaf9c561e366'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:45.053989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0bf7f8ae8b4ce38a9dcaf9c561e366'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:45.102041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0bf7f8ae8b4ce38a9dcaf9c561e366'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:45.135258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0bf7f8ae8b4ce38a9dcaf9c561e366'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:45.175080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1269/2546] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:44 2022] DELETE /identity/v3/users/3f0bf7f8ae8b4ce38a9dcaf9c561e366 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:45.177079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:45.177566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:45.177755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:45.238413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:45.239960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:45.473465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1278/2547] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:45.506278 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:45.508622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:45.598974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:45.646847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676076-a005-48ce-b111-c8228a64a393 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:45.653806 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:45.657506 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:45.657863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:45.658142 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:45.681633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:45.683488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:45.714138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1270/2548] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:46.237293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:46.239409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:46.255596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d23b16-751a-46d9-8156-074bd9755d14 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:46.261391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:46.262204 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:46.262479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:46.262750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] PATH_INFO: `/v3/projects/2948ec9f9b3043549cc08c5ca7715977` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:46.266069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2948ec9f9b3043549cc08c5ca7715977)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:46.268705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:46.346692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2948ec9f9b3043549cc08c5ca7715977', 'request_id': 'req-4ebd0286-84c6-42be-a422-c58659ebdfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.375446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2948ec9f9b3043549cc08c5ca7715977', 'request_id': 'req-4ebd0286-84c6-42be-a422-c58659ebdfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.390345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2948ec9f9b3043549cc08c5ca7715977', 'request_id': 'req-4ebd0286-84c6-42be-a422-c58659ebdfb5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.413332 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] The token cache is being invalidate because project 2948ec9f9b3043549cc08c5ca7715977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:46.413891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.416373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.420668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1279/2549] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:46 2022] DELETE /identity/v3/projects/2948ec9f9b3043549cc08c5ca7715977 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:46.428200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:46.441424 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45188-0f8f-41f9-92d5-329d6a7b86c4 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:46.545498 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:46.546333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:46.546745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:46.547023 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] PATH_INFO: `/v3/users/2f220d58718941cd87a5e853bff87e61` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:46.549475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f220d58718941cd87a5e853bff87e61)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:46.552048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:46.633222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f220d58718941cd87a5e853bff87e61'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.634067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f220d58718941cd87a5e853bff87e61'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.634687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f220d58718941cd87a5e853bff87e61'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.650363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f220d58718941cd87a5e853bff87e61'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.658389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e150910-9ca6-49c4-a204-c85f5e51dfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f220d58718941cd87a5e853bff87e61'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:46.680641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1271/2550] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:46 2022] DELETE /identity/v3/users/2f220d58718941cd87a5e853bff87e61 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:47.014544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.016186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:47.034275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0286-84c6-42be-a422-c58659ebdfb5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.068569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:47.126930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.128249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.128592 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.128932 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] PATH_INFO: `/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.130564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724ec681a2a34b6a8f3913503e4ccbc5)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.132727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.216571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724ec681a2a34b6a8f3913503e4ccbc5', 'request_id': 'req-1d596768-ed38-4b58-be50-6b38a78c4ea2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:47.224164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724ec681a2a34b6a8f3913503e4ccbc5', 'request_id': 'req-1d596768-ed38-4b58-be50-6b38a78c4ea2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:47.279904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724ec681a2a34b6a8f3913503e4ccbc5', 'request_id': 'req-1d596768-ed38-4b58-be50-6b38a78c4ea2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:47.298296 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] The token cache is being invalidate because project 724ec681a2a34b6a8f3913503e4ccbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:47.298865 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:47.299720 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1d596768-ed38-4b58-be50-6b38a78c4ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:47.301984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1280/2551] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:47 2022] DELETE /identity/v3/projects/724ec681a2a34b6a8f3913503e4ccbc5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:47.310330 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.311134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.311465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.332603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:47.334058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:47.417964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:47.454069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1272/2552] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:47.455937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.456225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.456506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.482374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:47.483785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:47.493094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1281/2553] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:47.497190 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.509542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfa902-2819-47a1-a508-e5fe0be4ffa3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.515909 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.516546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.516841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.517101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.517774 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:47.518085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.519770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.542878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1273/2554] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:47.545305 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.567849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931eb8-66c8-4701-b37c-b28dd28e2691 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.574161 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.574812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.575719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.576018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.576732 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.578688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.625964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1282/2555] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:47 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:47.629536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.655587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31131f22-77ce-48f9-951b-1898a0334119 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.761384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.762040 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.762334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.762606 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.763307 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.766968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.822547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1274/2556] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:47 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:39:47.827610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.846209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622b6d-8043-412c-b588-4da2de889636 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.859795 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.860515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.860966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.861242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.861909 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.866534 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.892950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.893492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1283/2557] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:47.908750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e833fe-9426-46b5-ba0c-7dcfde8daa55 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.918523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.919343 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.919724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.920100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.920880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.922738 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd911-7671-4c04-8ecd-a54713e6db15 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:47.939585 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1275/2558] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:39:47.940060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:47.956705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a2b1a-01fb-474d-acac-8f34baa9a74b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:47.962351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:47.963046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:47.963358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:47.963637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] PATH_INFO: `/v3/projects/1a13e42df5204a728a755921d4185437/users/da07b598c8f54f2982dcc3957b2bd775/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:47.982346 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a13e42df5204a728a755921d4185437, user_id=da07b598c8f54f2982dcc3957b2bd775, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:47.995354 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.030744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1284/2559] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:47 2022] PUT /identity/v3/projects/1a13e42df5204a728a755921d4185437/users/da07b598c8f54f2982dcc3957b2bd775/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:39:48.033320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.033320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.033320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.073350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] MFA Rules not processed for user `da07b598c8f54f2982dcc3957b2bd775`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:48.075105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:48.189403 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1276/2560] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:48.190187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.291005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:48.365492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30313-e468-48c9-9604-de5392bb21dd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.389586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.390286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.390563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.390832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.391569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.393506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.445513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1285/2561] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:48 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:39:48.449103 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.466336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c7bd-eda9-46ff-9ace-a35d126058d9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.547847 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:48.561027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.561670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.561948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.562593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.563625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.565646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.596426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1277/2562] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:48 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:48.600285 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.617757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0bf75-0b40-48e9-bd77-3e29771cd66d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.625256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.625889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.626173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.626435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.627744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.630146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.661568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1286/2563] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:48.666763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.686948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ee39-f3b7-49a6-b832-b3d761658b88 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.696115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.696709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.696994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.697274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] PATH_INFO: `/v3/projects/8535da4302f84542bb373b9783c30683/users/66c58ae67b174ff283be0605211e20f0/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.723320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8535da4302f84542bb373b9783c30683, user_id=66c58ae67b174ff283be0605211e20f0, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.726394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.754772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1278/2564] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:48 2022] PUT /identity/v3/projects/8535da4302f84542bb373b9783c30683/users/66c58ae67b174ff283be0605211e20f0/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:48.758610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.776715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467bf9-d363-4358-acfd-59e18ebd2203 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.865392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.866163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.866440 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.866714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.867407 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.869586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059301bc-4620-4c3f-8eae-f53ec70e0ab9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.882015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1287/2565] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:48.886851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:48.912598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ee3b-2c6d-48fc-855e-03fc837b62aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:48.921122 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:48.922102 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.922573 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.923014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] PATH_INFO: `/v3/projects/8535da4302f84542bb373b9783c30683/users/66c58ae67b174ff283be0605211e20f0/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.925248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8535da4302f84542bb373b9783c30683, user_id=66c58ae67b174ff283be0605211e20f0, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:48.928221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:48.953001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1279/2566] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:48 2022] PUT /identity/v3/projects/8535da4302f84542bb373b9783c30683/users/66c58ae67b174ff283be0605211e20f0/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:48.955181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:48.955517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:48.955797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:48.988957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] MFA Rules not processed for user `66c58ae67b174ff283be0605211e20f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:48.990277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:49.142896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1288/2567] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:49.154737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:49.156770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:49.336938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b223-f2b7-4a45-8d4b-41e73a814cb3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:49.349824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:49.350477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:49.350765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:49.351027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:49.373598 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:49.376770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:49.397953 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1280/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:49.520512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:49.544316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950532-c4b0-4778-89db-085af2f2e314 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:49.550403 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:49.551355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:49.553358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:49.553833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:49.627757 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:49.658471 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:49.660444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68f6af-c834-4212-a30e-ba8b26e2c840 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:49.672030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1289/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:39:50.181128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:50.282871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ea0c-0780-4f8e-b74f-98f687b2215a service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:50.301583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:50.303336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:50.303766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:50.304200 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] PATH_INFO: `/v3/users/da07b598c8f54f2982dcc3957b2bd775` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:50.305594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da07b598c8f54f2982dcc3957b2bd775)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:50.307764 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:50.394755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da07b598c8f54f2982dcc3957b2bd775'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.395805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da07b598c8f54f2982dcc3957b2bd775'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.396577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da07b598c8f54f2982dcc3957b2bd775'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.399112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:50.417789 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da07b598c8f54f2982dcc3957b2bd775'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.439794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da07b598c8f54f2982dcc3957b2bd775'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.463341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1281/2570] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:50 2022] DELETE /identity/v3/users/da07b598c8f54f2982dcc3957b2bd775 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:39:50.468110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:50.468398 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:50.468671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:50.503339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:50.506304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:50.624039 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1290/2571] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:50.635942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:50.637250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:50.735111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22660-a283-468d-978c-ebf3907c615c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:50.738990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:50.739828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:50.740251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:50.740824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:50.752734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:50.757020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:50.778214 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1282/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:50.823679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:50.825453 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:50.850044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6483fd6-81f2-4bfc-b35f-36b099703d49 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:50.857202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:50.858499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:50.859030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:50.859487 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] PATH_INFO: `/v3/users/1387566394594b66a6a5a97a1b5e5fa9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:50.860988 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1387566394594b66a6a5a97a1b5e5fa9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:50.863294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:50.928002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1387566394594b66a6a5a97a1b5e5fa9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.929154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1387566394594b66a6a5a97a1b5e5fa9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.931010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1387566394594b66a6a5a97a1b5e5fa9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.940236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1387566394594b66a6a5a97a1b5e5fa9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.955021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1387566394594b66a6a5a97a1b5e5fa9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:50.976202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1291/2573] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:50 2022] DELETE /identity/v3/users/1387566394594b66a6a5a97a1b5e5fa9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:51.341388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:51.353222 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920d6b-5d63-4b63-92bb-d7fee7f5b207 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:51.360225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:51.361787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:51.450133 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:51.467451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945bb88-352a-4783-89a8-07e22eaa78f4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:51.474960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:51.475759 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:51.476011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:51.477052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] PATH_INFO: `/v3/projects/1a13e42df5204a728a755921d4185437` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:51.478666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a13e42df5204a728a755921d4185437)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:51.480954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:51.540661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:51.541448 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:51.541829 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:51.542338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] PATH_INFO: `/v3/projects/1fae3f63e94a4bfc9f0863e1a09807fc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:51.544110 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fae3f63e94a4bfc9f0863e1a09807fc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:51.546438 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:51.636474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fae3f63e94a4bfc9f0863e1a09807fc', 'request_id': 'req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.649461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fae3f63e94a4bfc9f0863e1a09807fc', 'request_id': 'req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.664996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fae3f63e94a4bfc9f0863e1a09807fc', 'request_id': 'req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.679416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:51.690173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] The token cache is being invalidate because project 1fae3f63e94a4bfc9f0863e1a09807fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:51.691601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.692948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.695451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1283/2574] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:51 2022] DELETE /identity/v3/projects/1fae3f63e94a4bfc9f0863e1a09807fc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:51.699595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:51.702296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:51.738027 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a13e42df5204a728a755921d4185437', 'request_id': 'req-851559a8-ae4c-4204-9460-7be1568bed36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.746604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a13e42df5204a728a755921d4185437', 'request_id': 'req-851559a8-ae4c-4204-9460-7be1568bed36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.758694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a13e42df5204a728a755921d4185437', 'request_id': 'req-851559a8-ae4c-4204-9460-7be1568bed36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.775882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] The token cache is being invalidate because project 1a13e42df5204a728a755921d4185437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:51.776643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.777658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.779683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1292/2575] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:51 2022] DELETE /identity/v3/projects/1a13e42df5204a728a755921d4185437 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:51.783746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:51.785822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:51.800116 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74446c-f2aa-45e6-8a6c-aaacbd36f0bc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:51.876186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:51.876846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:51.877115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:51.877379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] PATH_INFO: `/v3/users/a1498a7c101349ad83afe9c183cb8e99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:51.878532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1498a7c101349ad83afe9c183cb8e99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:51.880510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:51.882743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851559a8-ae4c-4204-9460-7be1568bed36 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:51.892839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:51.893422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:51.893694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:51.893961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] PATH_INFO: `/v3/users/66c58ae67b174ff283be0605211e20f0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:51.896158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c58ae67b174ff283be0605211e20f0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:51.898942 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:51.955742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1498a7c101349ad83afe9c183cb8e99'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.956816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1498a7c101349ad83afe9c183cb8e99'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.957524 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1498a7c101349ad83afe9c183cb8e99'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.972139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1498a7c101349ad83afe9c183cb8e99'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.980930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1498a7c101349ad83afe9c183cb8e99'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.984512 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c58ae67b174ff283be0605211e20f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.985401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c58ae67b174ff283be0605211e20f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.986382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c58ae67b174ff283be0605211e20f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:51.996125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c58ae67b174ff283be0605211e20f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.001099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1284/2576] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:51 2022] DELETE /identity/v3/users/a1498a7c101349ad83afe9c183cb8e99 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:52.021827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c58ae67b174ff283be0605211e20f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.041097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:52.045663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1293/2577] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:51 2022] DELETE /identity/v3/users/66c58ae67b174ff283be0605211e20f0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:52.215317 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:52.216934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:52.282336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:52.365441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10176-ea7d-4b16-ac4c-f4d005da3c1e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:52.443758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:52.444434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.444710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.444990 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] PATH_INFO: `/v3/projects/cd757823774d4c2184e39c05b6b4943f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.446328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd757823774d4c2184e39c05b6b4943f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:52.448386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:52.521922 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd757823774d4c2184e39c05b6b4943f', 'request_id': 'req-05e4faa0-555d-47bb-8717-cf9cac85421e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.528243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd757823774d4c2184e39c05b6b4943f', 'request_id': 'req-05e4faa0-555d-47bb-8717-cf9cac85421e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.537115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd757823774d4c2184e39c05b6b4943f', 'request_id': 'req-05e4faa0-555d-47bb-8717-cf9cac85421e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.552640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] The token cache is being invalidate because project cd757823774d4c2184e39c05b6b4943f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:52.552929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.556230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05e4faa0-555d-47bb-8717-cf9cac85421e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.557001 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:52.558807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:52.559710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1285/2578] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:52 2022] DELETE /identity/v3/projects/cd757823774d4c2184e39c05b6b4943f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:52.573900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fefd29-4da6-49a3-88ac-9c9419a6803f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:52.646330 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:52.647010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.647331 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.647601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] PATH_INFO: `/v3/projects/8535da4302f84542bb373b9783c30683` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.648958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8535da4302f84542bb373b9783c30683)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:52.650959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:52.711140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8535da4302f84542bb373b9783c30683', 'request_id': 'req-c0046353-4cf1-4026-bdc9-a3307db0717b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.718574 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8535da4302f84542bb373b9783c30683', 'request_id': 'req-c0046353-4cf1-4026-bdc9-a3307db0717b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.728345 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8535da4302f84542bb373b9783c30683', 'request_id': 'req-c0046353-4cf1-4026-bdc9-a3307db0717b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.740577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] The token cache is being invalidate because project 8535da4302f84542bb373b9783c30683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:52.741342 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.741552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0046353-4cf1-4026-bdc9-a3307db0717b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:52.743159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1294/2579] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:52 2022] DELETE /identity/v3/projects/8535da4302f84542bb373b9783c30683 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:39:52.749085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.749485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.749759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.771546 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:52.772807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:52.837233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1286/2580] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:39:52.845577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.845862 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.846234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.868067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:52.869264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:52.877621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1295/2581] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:52.882113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:52.888648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:52.892680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb0f4-ab00-42a1-b153-bf83e78d2493 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:52.899009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:52.900015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.900500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.900833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.901568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:52.902079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:52.903771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:52.916041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1287/2582] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:52.920662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:52.930615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e095-734d-4bd1-aa6e-61af4f46f90a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:52.936386 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:52.937739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:52.938019 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:52.938288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:52.938916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:52.940863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:52.982555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1296/2583] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:52 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:52.984232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:52.999562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa64a9-b51c-421c-b5dc-2dae88214b7b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.063399 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.064015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.064289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.064559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.065185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.067111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.091622 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1288/2584] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:52 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:53.092688 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.103090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6e39-ce6a-4b87-b558-7b23b599a7ad admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.108053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.108679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.109043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.109312 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.109957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.111601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.122060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1297/2585] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:53.126894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.141676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ca4ad-8808-4faa-95eb-5e106f2a1e99 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.147411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.148049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.148331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.148600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.149255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.150851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aab73-9614-49d6-aa1f-51a3fcc7c4fc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.294631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1289/2586] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:53.299159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.309754 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2e56f-1b47-4125-9f3f-2007f8af30be admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.315220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.315923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.316191 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.316462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] PATH_INFO: `/v3/projects/a020f6d1ebd74c8bb67e84cc81f59bd3/users/99b06008ce074d83aa1c0c69e9dc627c/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.332023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a020f6d1ebd74c8bb67e84cc81f59bd3, user_id=99b06008ce074d83aa1c0c69e9dc627c, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.334667 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.348982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1298/2587] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:53 2022] PUT /identity/v3/projects/a020f6d1ebd74c8bb67e84cc81f59bd3/users/99b06008ce074d83aa1c0c69e9dc627c/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:53.360545 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.360661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.360904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.388053 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] MFA Rules not processed for user `99b06008ce074d83aa1c0c69e9dc627c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:53.389306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:53.461121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1290/2588] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:53.473159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.474965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:53.506579 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:53.537336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740fd5-6cc1-4589-9d1a-f3e82ee47352 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.541605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.542785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.543275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.543554 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.554491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.555992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552400ff-5b2c-4f3a-89bf-e358ecc3a9eb service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.567047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1299/2589] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:53.587583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.653706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be9534-c647-41d2-a6fa-a9b3e803b65b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.658625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.659294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.659568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.659832 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] PATH_INFO: `/v3/users/99b06008ce074d83aa1c0c69e9dc627c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.660994 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b06008ce074d83aa1c0c69e9dc627c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.662904 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.664837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:53.717097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b06008ce074d83aa1c0c69e9dc627c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:53.718713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b06008ce074d83aa1c0c69e9dc627c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:53.719571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b06008ce074d83aa1c0c69e9dc627c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:53.732501 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b06008ce074d83aa1c0c69e9dc627c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:53.739553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b06008ce074d83aa1c0c69e9dc627c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:53.754172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1291/2590] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:39:53 2022] DELETE /identity/v3/users/99b06008ce074d83aa1c0c69e9dc627c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:53.758817 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.759362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.759633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.780743 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:53.782304 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:53.845606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1300/2591] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:53.855432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:53.856961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:53.913739 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ea47f-0e5e-4f85-8990-28dfdb6e87c2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:53.917740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:53.918371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:53.918641 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:53.918884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:53.929986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:53.932408 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b0259-f6f1-4ea2-a3a5-eadb47893989 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:53.948714 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1292/2592] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:54.225617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.227130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:54.248351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6ae68-9561-4f21-b673-c02253496c35 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.254751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.255433 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.255709 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.255976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] PATH_INFO: `/v3/projects/a020f6d1ebd74c8bb67e84cc81f59bd3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.257786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a020f6d1ebd74c8bb67e84cc81f59bd3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.260180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.307992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a020f6d1ebd74c8bb67e84cc81f59bd3', 'request_id': 'req-1e98ffef-93f0-4664-963e-6f8f9194da34'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:54.314904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a020f6d1ebd74c8bb67e84cc81f59bd3', 'request_id': 'req-1e98ffef-93f0-4664-963e-6f8f9194da34'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:54.323777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a020f6d1ebd74c8bb67e84cc81f59bd3', 'request_id': 'req-1e98ffef-93f0-4664-963e-6f8f9194da34'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:54.336490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] The token cache is being invalidate because project a020f6d1ebd74c8bb67e84cc81f59bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:39:54.336864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:54.337586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1e98ffef-93f0-4664-963e-6f8f9194da34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:39:54.339160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1301/2593] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:39:54 2022] DELETE /identity/v3/projects/a020f6d1ebd74c8bb67e84cc81f59bd3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:54.345247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.345696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.346124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.376463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:54.377683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:54.448266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1293/2594] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:54.456470 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.456752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.457023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.477352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:54.478564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:54.487314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1302/2595] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:54.491870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.502171 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7d331-bc66-4570-a6f7-334fad48005e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.507519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.508121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.508392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.508660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.509314 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:39:54.509611 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.511223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.523528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1294/2596] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:39:54.528419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.538240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3767-dbaa-4b15-93d0-5a1fdb5c6ab6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.543212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.543824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.544098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.544360 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.545004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.546930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.576495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1303/2597] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:39:54 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:54.580919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.591233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08927-a26d-4571-aaf9-5600a1e53df5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.596456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:54.654320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.654945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.655230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.655552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.656271 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.658188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.682070 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1295/2598] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:39:54 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:39:54.688388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.699422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c91dc-5cd3-4d79-bc1a-8e05b261bd53 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.705490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.706094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.706370 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.706637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.707324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.708922 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.719129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1304/2599] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:54.723419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.733686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729dc2-a984-466e-aded-f74d67a9b89b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.741770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.742637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.742976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.743394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.744390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.746766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4886f20-ae3b-4f64-aed5-7b4bffca0b8b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.760881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1296/2600] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:39:54.765299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.775622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c7766-cbc7-4353-a481-dd31b07cce03 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:54.780641 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:54.781295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.781568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.781842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] PATH_INFO: `/v3/projects/2babc3c10e114e4aaef23cc6892989a6/users/a3dc9b61c7734d1983d874310a3dca6b/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.793212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:54.798839 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2babc3c10e114e4aaef23cc6892989a6, user_id=a3dc9b61c7734d1983d874310a3dca6b, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:54.801494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:54.818504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1305/2601] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:39:54 2022] PUT /identity/v3/projects/2babc3c10e114e4aaef23cc6892989a6/users/a3dc9b61c7734d1983d874310a3dca6b/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:39:54.828731 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:54.828988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:54.829209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:54.858152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] MFA Rules not processed for user `a3dc9b61c7734d1983d874310a3dca6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:54.859459 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:54.926562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1297/2602] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:39:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:54.938243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:54.940126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:54.996561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4183d7-79e6-43ee-9f57-af5f4b81daad admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:55.000497 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1daf3ae711f0440ca0b26d214a162074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:55.001113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:55.001378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:55.001644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:55.009965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:55.011424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d67a-270c-4fe6-83b2-1c8310c72b14 service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:55.020082 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1306/2603] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:57.039677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:57.041441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:57.101612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3898-e857-4747-9d0d-604b948f87ab None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:57.105321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:57.105930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:57.106199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:57.106463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:57.108240 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:57.118031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:57.119481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:57.127701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1298/2604] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:39:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:39:59.325503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:59.326096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:59.326096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:59.346645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:39:59.347864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:59.407979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1307/2605] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Aug 7 19:39:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:39:59.420380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:39:59.422157 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:39:59.448582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:39:59.500115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847896b5-8d0a-4480-bcf4-93adeac4a8fe service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:39:59.508109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:39:59.508969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:39:59.509331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:39:59.509613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:39:59.522696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:39:59.524262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7e4b7-7cff-4964-9d8c-3044842ce865 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:39:59.533005 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1299/2606] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:39:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:09.400493 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:09.529469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=23 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:11.781108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:11.848794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911a0e2-68d6-491b-a1cd-9a2c50034a0a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:11.853756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:11.854365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:11.854628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:11.854884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] PATH_INFO: `/v3/users/a3dc9b61c7734d1983d874310a3dca6b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:11.856058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dc9b61c7734d1983d874310a3dca6b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:11.858032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:11.909965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dc9b61c7734d1983d874310a3dca6b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:11.910649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dc9b61c7734d1983d874310a3dca6b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:11.911309 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dc9b61c7734d1983d874310a3dca6b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:11.918851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dc9b61c7734d1983d874310a3dca6b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:11.935969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dc9b61c7734d1983d874310a3dca6b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:11.952790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1308/2607] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:40:11 2022] DELETE /identity/v3/users/a3dc9b61c7734d1983d874310a3dca6b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:11.957392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:11.957876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:11.957982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:11.977262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:11.978467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:12.045132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1300/2608] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:12.056650 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:12.058121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:12.118967 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93368-5621-4692-b74b-12b4a8c7024f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:12.122958 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:12.123590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:12.123859 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:12.124130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:12.134012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:12.135394 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b8ee5-13d2-41a1-b7c9-d1da2c23b9b1 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:12.144804 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1309/2609] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:12.430528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:12.432756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:12.451095 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60fd5c-6365-4181-88c6-3b2978c3d97e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:12.458251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:12.458876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:12.459135 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:12.459449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] PATH_INFO: `/v3/projects/2babc3c10e114e4aaef23cc6892989a6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:12.460960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2babc3c10e114e4aaef23cc6892989a6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:12.463028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:12.522579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2babc3c10e114e4aaef23cc6892989a6', 'request_id': 'req-27b3949e-eed0-4723-890c-282a34b6c10b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:12.529358 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2babc3c10e114e4aaef23cc6892989a6', 'request_id': 'req-27b3949e-eed0-4723-890c-282a34b6c10b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:12.537540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2babc3c10e114e4aaef23cc6892989a6', 'request_id': 'req-27b3949e-eed0-4723-890c-282a34b6c10b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:12.548828 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] The token cache is being invalidate because project 2babc3c10e114e4aaef23cc6892989a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:40:12.549043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:12.549749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:12.551374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1301/2610] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:40:12 2022] DELETE /identity/v3/projects/2babc3c10e114e4aaef23cc6892989a6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:16.797374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:16.797864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:16.797960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:16.818877 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] MFA Rules not processed for user `35c6943e3d5a443eb84b719e0bb60885`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:16.820194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:16.840148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:16.880377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1310/2611] 10.222.0.15 () {58 vars in 967 bytes} [Sun Aug 7 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:16.896765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:16.898878 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:16.973428 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3949e-eed0-4723-890c-282a34b6c10b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:16.978791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8b65b2e324e9c9cbb4e18c715f4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:16.979436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:16.979712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:16.979983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:16.988660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:16.990252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:16.999037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1302/2612] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Aug 7 19:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 19:40:26.243925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:26.246796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:26.334832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208a1d-5674-4e8f-9337-014fc3ee6ba6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:26.340562 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:26.341212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:26.341484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:26.341751 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:26.343622 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:26.411890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:26.413550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:26.423521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1311/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:26.995706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:36.418756 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=71 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:46.942597 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:46.944551 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:47.012620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc3faf-6124-4f6e-99bc-a4819720c22d service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:47.016838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:47.017481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:47.017727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:47.018019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:47.019866 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:47.084727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:47.086159 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:47.095945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1303/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:50.315023 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:50.316520 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:50.391892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:50.393811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:50.405451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7bb5d-c212-467d-82bb-b55ea688b68f service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:50.406867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70107-49d3-4c1a-aa1e-cfc91459d888 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:50.410662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:50.411387 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:50.411722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:50.412046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:50.412180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:50.412736 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:50.412952 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:50.413238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] PATH_INFO: `/v3/users/525edac979aa45e3adb880f99dfb3345` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:50.413975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:50.414436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525edac979aa45e3adb880f99dfb3345)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:50.416410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:50.425664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:50.427356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:50.438152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1312/2615] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:50.469472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525edac979aa45e3adb880f99dfb3345'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.470131 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525edac979aa45e3adb880f99dfb3345'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.470727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525edac979aa45e3adb880f99dfb3345'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.483031 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525edac979aa45e3adb880f99dfb3345'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.489775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d6284f5d-8fda-4fe7-9143-8c09830c3819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525edac979aa45e3adb880f99dfb3345'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.508957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1304/2616] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:40:50 2022] DELETE /identity/v3/users/525edac979aa45e3adb880f99dfb3345 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:40:50.687517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:50.699172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c53f6-4b63-43c9-83ce-f528ac7a21cd service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:50.756405 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:50.757043 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:50.757319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:50.757587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] PATH_INFO: `/v3/projects/077f5f00167e4a68a1afa2d4e43f1c65` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:50.758739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077f5f00167e4a68a1afa2d4e43f1c65)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:50.760699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:50.816186 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077f5f00167e4a68a1afa2d4e43f1c65', 'request_id': 'req-0890a1a0-33bf-41f2-beb9-a64212d486f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.823413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077f5f00167e4a68a1afa2d4e43f1c65', 'request_id': 'req-0890a1a0-33bf-41f2-beb9-a64212d486f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.833522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077f5f00167e4a68a1afa2d4e43f1c65', 'request_id': 'req-0890a1a0-33bf-41f2-beb9-a64212d486f0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.844435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] The token cache is being invalidate because project 077f5f00167e4a68a1afa2d4e43f1c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:40:50.844717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.845343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0890a1a0-33bf-41f2-beb9-a64212d486f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:50.846872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1313/2617] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:40:50 2022] DELETE /identity/v3/projects/077f5f00167e4a68a1afa2d4e43f1c65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:50.852180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:50.852469 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:50.852746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:50.873385 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:50.874699 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:50.898003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:50.956536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1305/2618] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:50.964917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:50.965237 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:50.965506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:50.988080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:50.989335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:50.998766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1314/2619] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:51.005294 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.017796 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97b4af-000f-4515-b829-2103ed5ec5a7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.023415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.024015 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.024287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.024550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.025209 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:40:51.025504 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.027093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.042120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1306/2620] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:40:51.047059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.056502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a174-c0b8-4968-b0ba-246a79ca6475 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.061421 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.062028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.062303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.062571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.063617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.065529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.077777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:51.096092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1315/2621] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:40:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:51.101089 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.113721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725723-ce8f-4c4b-b519-9bb30cbb19f2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.172235 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.172874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.173147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.173415 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.174033 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.176124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.198750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1307/2622] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:40:51 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:51.203767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.213914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211907a6-7024-42b7-b5df-690feba99a6c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.218455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.219025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.219318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.219581 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.220222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.221805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.231907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1316/2623] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:40:51.235988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.246794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e0c76-7020-4768-bd03-d7f0faea95ba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.253983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.254187 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.254426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.254688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.259837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.259837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6173b-6ed7-44f5-9af1-c183fade5579 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.269252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1308/2624] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:40:51.273689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.287696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760e0af-cb08-4cec-b0e0-996b58c97bf8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.293060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.293760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.294028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.294399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] PATH_INFO: `/v3/projects/7d60f21186ab420ca3a6e0a8d85206b2/users/58b12e7e74ae4635bab740e3f083a69a/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.310744 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d60f21186ab420ca3a6e0a8d85206b2, user_id=58b12e7e74ae4635bab740e3f083a69a, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.313816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.329034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1317/2625] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:40:51 2022] PUT /identity/v3/projects/7d60f21186ab420ca3a6e0a8d85206b2/users/58b12e7e74ae4635bab740e3f083a69a/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:51.339894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.340189 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.340443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.369929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] MFA Rules not processed for user `58b12e7e74ae4635bab740e3f083a69a`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:51.371173 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:51.437321 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1309/2626] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:51.449397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:51.451323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:51.524460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d5845-fa75-4a70-8d8e-6a38237927de admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:51.530708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:51.531335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:51.531605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:51.531867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:51.540207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:51.541815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:51.551644 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1318/2627] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:55.826084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:55.827715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:55.849490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:55.890561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe345a8-214d-4a25-93f4-c0824cdf79ad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:55.894460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:55.895073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:55.895380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:55.895652 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:55.897479 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:55.962587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:55.964063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760cb01-af53-4f6f-b335-d2b1885415b4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:55.974085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1310/2628] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:56.822532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:56.889665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9371-ab59-4a4b-a96e-86ee7f2dfd8a service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:56.894699 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:56.895377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:56.895651 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:56.895917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] PATH_INFO: `/v3/users/58b12e7e74ae4635bab740e3f083a69a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:56.897037 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b12e7e74ae4635bab740e3f083a69a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:56.899070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:56.947506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:56.950144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b12e7e74ae4635bab740e3f083a69a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:56.950939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b12e7e74ae4635bab740e3f083a69a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:56.951746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b12e7e74ae4635bab740e3f083a69a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:56.960890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b12e7e74ae4635bab740e3f083a69a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:56.973144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b12e7e74ae4635bab740e3f083a69a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:56.989711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1319/2629] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:40:56 2022] DELETE /identity/v3/users/58b12e7e74ae4635bab740e3f083a69a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:56.994333 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:56.994872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:56.994872 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.016494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:57.016494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:57.090253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1311/2630] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:57.100368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:57.101810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:57.168684 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5be6-5d07-4563-898b-9531ddc9fbc2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:57.172601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:57.173227 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.173500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.173773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.183249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:57.185954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecbabf-52b3-4eb6-981f-8a98d54e16e3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:57.197820 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1320/2631] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:57.615496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:57.617054 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:57.637101 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63ae9f-1485-4f0d-ad6c-cfca09f6bec2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:57.649734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:57.650404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.650679 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.650947 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] PATH_INFO: `/v3/projects/7d60f21186ab420ca3a6e0a8d85206b2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.652175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d60f21186ab420ca3a6e0a8d85206b2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:57.654120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:57.706071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d60f21186ab420ca3a6e0a8d85206b2', 'request_id': 'req-4b21efaf-6558-4160-ba27-cb9e907f1d5b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:57.712387 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d60f21186ab420ca3a6e0a8d85206b2', 'request_id': 'req-4b21efaf-6558-4160-ba27-cb9e907f1d5b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:57.721609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d60f21186ab420ca3a6e0a8d85206b2', 'request_id': 'req-4b21efaf-6558-4160-ba27-cb9e907f1d5b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:57.726541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:57.734043 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] The token cache is being invalidate because project 7d60f21186ab420ca3a6e0a8d85206b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:40:57.735226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:57.735490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b21efaf-6558-4160-ba27-cb9e907f1d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:57.737625 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1312/2632] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:40:57 2022] DELETE /identity/v3/projects/7d60f21186ab420ca3a6e0a8d85206b2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:57.742393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.742679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.742951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.762513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:57.763883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:57.825263 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1321/2633] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:57.833517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.833797 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.834077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.855578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:57.856773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:57.865960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1313/2634] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:57.871109 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:57.881335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea529ab-7b61-49de-a6d7-63ac2feb079d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:57.887058 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:57.887698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.887971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.888234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.888886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:40:57.889340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:57.890927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:57.906002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1322/2635] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:40:57.907138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:57.916154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e5302-bcec-4915-9112-94d8e3e2792e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:57.921177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:57.921863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:57.922202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:57.922541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:57.923309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:57.925338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:57.953978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1314/2636] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:57.958123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:57.968201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a9ce-77a6-434f-b154-6cdfe5882f6d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.020672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:58.034959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.035760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.036034 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.036295 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.036947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.038917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.064525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1323/2637] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:40:57 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:58.068729 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.079522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770fc5-ef31-4e67-8425-ebe95a65b1b9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.087246 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.087865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.088139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.088410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.089067 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.090737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.103499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1315/2638] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:40:58.108218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.119605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da1b84-5ddd-451a-9bf6-ad6b0c863ad2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.125011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.125646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.125925 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.126196 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.126848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.128584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5a0d9-a134-4f68-bc05-4221f2d40356 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.142479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1324/2639] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:40:58.146867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.170715 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4898123-39c0-4615-b4bf-a671742b7b8b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.176228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.177018 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.177365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.177703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] PATH_INFO: `/v3/projects/e7fb275fe585498b911dcfbf0500c09c/users/7f5baed315c54bb69b9a1e525debb5f1/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.196693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fb275fe585498b911dcfbf0500c09c, user_id=7f5baed315c54bb69b9a1e525debb5f1, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.199685 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.216456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1316/2640] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:40:58 2022] PUT /identity/v3/projects/e7fb275fe585498b911dcfbf0500c09c/users/7f5baed315c54bb69b9a1e525debb5f1/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:58.228816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.229367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.229771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.272435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] MFA Rules not processed for user `7f5baed315c54bb69b9a1e525debb5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:58.274411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:58.353350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1325/2641] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:58.358384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.419578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df00b6-8c8e-4347-a54c-04b2bf3a3533 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.424262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.424876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.425153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.425420 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.426093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.428036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.458026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1317/2642] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:40:58 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:58.462126 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.473096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150df8d0-bd68-4560-9cd0-13602cc0f00b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.535025 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.535674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.535954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.536230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.536868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.538788 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.563613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1326/2643] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:40:58 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:40:58.567870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.579312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039539-af66-4ac7-8024-35b9e51f1a34 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.585141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.585735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.586047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.586292 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.586933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.588568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.601693 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1318/2644] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:40:58.605905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.616382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8423-6533-4f62-9344-ffec439a3cd4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.621866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.622519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.622791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.623057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] PATH_INFO: `/v3/projects/37f14cabec054ddb8cb09f4019c92552/users/000508601f184ed8a06f1fcf9b68b927/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.639328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f14cabec054ddb8cb09f4019c92552, user_id=000508601f184ed8a06f1fcf9b68b927, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.642247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.657504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1327/2645] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:40:58 2022] PUT /identity/v3/projects/37f14cabec054ddb8cb09f4019c92552/users/000508601f184ed8a06f1fcf9b68b927/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:58.661833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.672465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafef9e-6fba-49ae-a4b2-9fb3d41d1f14 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.733300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.733816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.734107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.734356 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.734996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.736668 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd05e1-005d-4e85-9605-98ec66107f6b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.747964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1319/2646] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:40:58.752218 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.763045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff197c00-69b4-464f-8ab3-362424996708 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.770711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.771510 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.771798 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.772077 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] PATH_INFO: `/v3/projects/37f14cabec054ddb8cb09f4019c92552/users/000508601f184ed8a06f1fcf9b68b927/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.774464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f14cabec054ddb8cb09f4019c92552, user_id=000508601f184ed8a06f1fcf9b68b927, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.777149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:58.788495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1328/2647] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:40:58 2022] PUT /identity/v3/projects/37f14cabec054ddb8cb09f4019c92552/users/000508601f184ed8a06f1fcf9b68b927/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:40:58.798958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.799279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.799554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.807032 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:58.831083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] MFA Rules not processed for user `000508601f184ed8a06f1fcf9b68b927`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:58.832348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:58.903679 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1320/2648] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:58.915731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:58.917521 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:58.932553 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:58.983062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0198899-c93d-4a93-a4fb-d0245258ec70 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:58.987088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:58.987679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:58.987955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:58.988221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:58.997686 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:58.999314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8fd35-2b4d-446c-9785-a4c3bfafcc32 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:59.008954 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1329/2649] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:40:59.455653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:59.518710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca65a-b84e-4864-a853-58134f96b126 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:59.523044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:59.523709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:59.523983 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:59.524248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] PATH_INFO: `/v3/users/7f5baed315c54bb69b9a1e525debb5f1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:59.525397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5baed315c54bb69b9a1e525debb5f1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:59.527335 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:59.579484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5baed315c54bb69b9a1e525debb5f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:59.580161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5baed315c54bb69b9a1e525debb5f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:59.580842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5baed315c54bb69b9a1e525debb5f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:59.594152 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5baed315c54bb69b9a1e525debb5f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:59.601112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5baed315c54bb69b9a1e525debb5f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:40:59.614960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1321/2650] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:40:59 2022] DELETE /identity/v3/users/7f5baed315c54bb69b9a1e525debb5f1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:40:59.619702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:59.619982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:59.620250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:59.639277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:40:59.640472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:59.705739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1330/2651] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:40:59.715737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:40:59.717258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:40:59.727740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:40:59.800648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9de19-43b9-4e38-b581-ed2d61510f98 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:40:59.804996 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:40:59.806893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:40:59.807169 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:40:59.807474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:40:59.819346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:40:59.821798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:40:59.834431 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1322/2652] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:00.398701 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:00.400543 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:00.417628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e269458-9995-4a93-b119-86f3e5ce81b1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:00.427745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:00.428722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:00.429142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:00.429550 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] PATH_INFO: `/v3/projects/e7fb275fe585498b911dcfbf0500c09c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:00.439101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fb275fe585498b911dcfbf0500c09c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:00.442318 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:00.522674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fb275fe585498b911dcfbf0500c09c', 'request_id': 'req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.531241 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fb275fe585498b911dcfbf0500c09c', 'request_id': 'req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.542182 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fb275fe585498b911dcfbf0500c09c', 'request_id': 'req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.559549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] The token cache is being invalidate because project e7fb275fe585498b911dcfbf0500c09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:00.559750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.560401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.563214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1331/2653] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:00 2022] DELETE /identity/v3/projects/e7fb275fe585498b911dcfbf0500c09c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:00.566865 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:00.577016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99549-ee67-4630-b4c4-f9de3f5aa2be service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:00.639775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:00.640464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:00.640756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:00.641013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] PATH_INFO: `/v3/users/000508601f184ed8a06f1fcf9b68b927` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:00.642151 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000508601f184ed8a06f1fcf9b68b927)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:00.644119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:00.710111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000508601f184ed8a06f1fcf9b68b927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.710784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000508601f184ed8a06f1fcf9b68b927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.711412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000508601f184ed8a06f1fcf9b68b927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.724755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000508601f184ed8a06f1fcf9b68b927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.732309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a203f7e0-162a-4e2a-b791-548c048741d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000508601f184ed8a06f1fcf9b68b927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:00.758461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1323/2654] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:00 2022] DELETE /identity/v3/users/000508601f184ed8a06f1fcf9b68b927 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:01.322643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:01.324950 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:01.366408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b24f2-d9dd-4b39-a9c1-42d8da698c72 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:01.432200 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:01.476452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:01.477600 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.478080 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.478586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] PATH_INFO: `/v3/projects/37f14cabec054ddb8cb09f4019c92552` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.480390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f14cabec054ddb8cb09f4019c92552)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:01.485568 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:01.579035 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f14cabec054ddb8cb09f4019c92552', 'request_id': 'req-37042e93-a018-4a34-b558-199e1de3ad95'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:01.588947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f14cabec054ddb8cb09f4019c92552', 'request_id': 'req-37042e93-a018-4a34-b558-199e1de3ad95'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:01.598191 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f14cabec054ddb8cb09f4019c92552', 'request_id': 'req-37042e93-a018-4a34-b558-199e1de3ad95'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:01.614633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] The token cache is being invalidate because project 37f14cabec054ddb8cb09f4019c92552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:01.614929 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:01.616099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-37042e93-a018-4a34-b558-199e1de3ad95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:01.617220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1332/2655] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:01 2022] DELETE /identity/v3/projects/37f14cabec054ddb8cb09f4019c92552 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:01.622264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.622921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.622921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.642650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:01.643929 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:01.670203 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:01.710364 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1324/2656] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:01.719334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.719698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.720449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.742604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:01.743962 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:01.756264 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1333/2657] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:01.757534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:01.769579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db18c51-d8da-42fd-aa9c-89c8b1541e5c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:01.774634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:01.776047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.776361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.776596 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.777248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:01.777724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:01.779442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:01.795566 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1325/2658] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:41:01.796767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:01.821073 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d32b5-695a-4c24-9979-04077eb601ae None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:01.831552 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:01.832718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.832902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.833177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.833822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:01.835762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:01.865833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1334/2659] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:01.870193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:01.881985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60c41-b656-4215-853e-ca9e640923da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:01.949825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:01.950439 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:01.950717 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:01.950987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:01.951701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:01.953630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:01.982452 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1326/2660] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:01 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:01.991444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.004637 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664686-f9a3-4aa0-b51e-1fb1a87e9b56 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.009337 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.009939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.010212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.010474 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.011129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.012733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.023326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1335/2661] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:02.027472 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.037858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9458ab-d06c-48b1-8d4d-86a1512ff56c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.043808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.043808 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.044099 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.044348 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.045024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.046758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc337ae3-e5c0-4b12-8cfd-570f7453c957 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.059342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1327/2662] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:02.064028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.075101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ae1e-bf9d-4f4c-9c92-751c183fa525 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.079960 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.080639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.080912 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.081178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] PATH_INFO: `/v3/projects/88cbf095d2fe4731b4835aad91d8ea42/users/d88b099f805842b3b51f294d69378373/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.097643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cbf095d2fe4731b4835aad91d8ea42, user_id=d88b099f805842b3b51f294d69378373, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.100336 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.117141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1336/2663] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:02 2022] PUT /identity/v3/projects/88cbf095d2fe4731b4835aad91d8ea42/users/d88b099f805842b3b51f294d69378373/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:02.128834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.129297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.129746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.161769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] MFA Rules not processed for user `d88b099f805842b3b51f294d69378373`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:02.163093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:02.247751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1328/2664] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:02.251990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.332994 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe72b-061b-4806-adec-8f5c34f22b39 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.342939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37388-6479-4865-b132-282d31439dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.343774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37388-6479-4865-b132-282d31439dba admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.344096 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37388-6479-4865-b132-282d31439dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.344401 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37388-6479-4865-b132-282d31439dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.345117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37388-6479-4865-b132-282d31439dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.348294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37388-6479-4865-b132-282d31439dba admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.359502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:02.383235 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1337/2665] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:02 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:02.388284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.401811 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e388c1-60d0-4cdd-89d2-f62e4426b3cc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.424078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:02.465140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.465898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.466166 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.466432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.467084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.469114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.490405 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1329/2666] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:02 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:02.495463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37388-6479-4865-b132-282d31439dba admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.506515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37388-6479-4865-b132-282d31439dba admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.511949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.512605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.512882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.513159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.513818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.515601 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.530636 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1338/2667] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:02.534879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.545322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c520f6-24c5-4748-b0c8-cca368589d5f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.550182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.550840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.551121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.551429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] PATH_INFO: `/v3/projects/bdeae8a345c1479a8108d61010577a1b/users/68b91833ce7c45938188416f7aa50c44/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.566805 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdeae8a345c1479a8108d61010577a1b, user_id=68b91833ce7c45938188416f7aa50c44, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.569486 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.589455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1330/2668] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:02 2022] PUT /identity/v3/projects/bdeae8a345c1479a8108d61010577a1b/users/68b91833ce7c45938188416f7aa50c44/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:02.594502 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.605255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6f189-1302-4263-bbdb-a57247c4bf2a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.663593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.664207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.664483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.664755 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.665404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.667007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600f85-78a5-4f11-a8e3-8b26af2c8578 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.676810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1339/2669] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:02.683444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.695478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282341-32f8-4295-bb6a-36eeea74db1a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.700974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.701636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.701937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.702202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] PATH_INFO: `/v3/projects/bdeae8a345c1479a8108d61010577a1b/users/68b91833ce7c45938188416f7aa50c44/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.704248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdeae8a345c1479a8108d61010577a1b, user_id=68b91833ce7c45938188416f7aa50c44, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.707034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.717646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1331/2670] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:02 2022] PUT /identity/v3/projects/bdeae8a345c1479a8108d61010577a1b/users/68b91833ce7c45938188416f7aa50c44/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:02.728791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.729078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.729468 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.758135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] MFA Rules not processed for user `68b91833ce7c45938188416f7aa50c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:02.759400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:02.828973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1340/2671] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:02.840840 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:02.843084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:02.904411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc794b-103b-4555-9391-6d163c31fc20 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:02.908365 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:02.908973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:02.909210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:02.909477 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:02.919491 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:02.920960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d1ae3-2e72-4897-8e2e-57dd1085653e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:02.930503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1332/2672] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:03.000815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:03.083613 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eab1a-b1b4-439b-a99e-a80c22552ab3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:03.088265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:03.088902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:03.089173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:03.089436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] PATH_INFO: `/v3/users/d88b099f805842b3b51f294d69378373` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:03.090607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88b099f805842b3b51f294d69378373)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:03.092602 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:03.094221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:03.144188 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88b099f805842b3b51f294d69378373'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.144855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88b099f805842b3b51f294d69378373'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.145555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88b099f805842b3b51f294d69378373'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.152615 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88b099f805842b3b51f294d69378373'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.164878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88b099f805842b3b51f294d69378373'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.180163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1341/2673] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:02 2022] DELETE /identity/v3/users/d88b099f805842b3b51f294d69378373 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:03.184702 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:03.184987 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:03.185277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:03.204298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:03.205496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:03.279220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1333/2674] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:03.289209 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:03.290721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:03.348842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01f0a-e5f3-41c7-a0a3-be4a1eff8a14 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:03.352549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:03.353164 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:03.353431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:03.353694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:03.363374 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:03.364807 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:03.374822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1342/2675] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:03.740864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:03.751716 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b0f3-a064-4415-9213-016c39153cf5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:03.756367 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:03.756986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:03.757449 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:03.757819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:03.760362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:03.774495 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:03.775980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:03.787167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1334/2676] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:41:03.836845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:03.838274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:03.854856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdbab0-bfd2-42a1-b2ba-322867df6406 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:03.866047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:03.867457 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:03.867883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:03.868504 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] PATH_INFO: `/v3/projects/88cbf095d2fe4731b4835aad91d8ea42` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:03.869899 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cbf095d2fe4731b4835aad91d8ea42)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:03.873205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:03.936375 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cbf095d2fe4731b4835aad91d8ea42', 'request_id': 'req-150c495b-05c6-4d71-beef-a2a07386682c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.943290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cbf095d2fe4731b4835aad91d8ea42', 'request_id': 'req-150c495b-05c6-4d71-beef-a2a07386682c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.953203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cbf095d2fe4731b4835aad91d8ea42', 'request_id': 'req-150c495b-05c6-4d71-beef-a2a07386682c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.967017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] The token cache is being invalidate because project 88cbf095d2fe4731b4835aad91d8ea42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:03.967379 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.968168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:03.969733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1343/2677] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:03 2022] DELETE /identity/v3/projects/88cbf095d2fe4731b4835aad91d8ea42 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:03.974690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:03.985117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44119b5-88bc-49d3-9ee7-fde115ad2876 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:03.989745 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:04.052475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:04.053129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.053500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.053748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] PATH_INFO: `/v3/users/68b91833ce7c45938188416f7aa50c44` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.055412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b91833ce7c45938188416f7aa50c44)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:04.057360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:04.111610 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b91833ce7c45938188416f7aa50c44'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.112267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b91833ce7c45938188416f7aa50c44'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.112888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b91833ce7c45938188416f7aa50c44'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.126593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b91833ce7c45938188416f7aa50c44'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.133396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea864e11-09a5-43c0-bba5-a4f6ededb64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b91833ce7c45938188416f7aa50c44'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.148349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1335/2678] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:03 2022] DELETE /identity/v3/users/68b91833ce7c45938188416f7aa50c44 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:04.567428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:04.568927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:04.582316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:04.589292 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c495b-05c6-4d71-beef-a2a07386682c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:04.654773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:04.655462 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.655872 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.655989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] PATH_INFO: `/v3/projects/bdeae8a345c1479a8108d61010577a1b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.657169 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdeae8a345c1479a8108d61010577a1b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:04.659104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:04.720187 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdeae8a345c1479a8108d61010577a1b', 'request_id': 'req-7dc53779-fa25-454a-ace2-3ff027837f74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.727895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdeae8a345c1479a8108d61010577a1b', 'request_id': 'req-7dc53779-fa25-454a-ace2-3ff027837f74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.736668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdeae8a345c1479a8108d61010577a1b', 'request_id': 'req-7dc53779-fa25-454a-ace2-3ff027837f74'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.747525 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] The token cache is being invalidate because project bdeae8a345c1479a8108d61010577a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:04.747854 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.748507 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7dc53779-fa25-454a-ace2-3ff027837f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:04.750517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1344/2679] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:04 2022] DELETE /identity/v3/projects/bdeae8a345c1479a8108d61010577a1b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:04.755523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.756057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.756175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.776407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:04.777634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:04.850778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1336/2680] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:41:04.858639 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28382-f973-42be-942e-9fb15df740ca None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.859262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28382-f973-42be-942e-9fb15df740ca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.859262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28382-f973-42be-942e-9fb15df740ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.882283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-baa28382-f973-42be-942e-9fb15df740ca None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:04.883477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-baa28382-f973-42be-942e-9fb15df740ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:04.896607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1345/2681] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:04.897792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:04.910297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d02b3a-5ffe-49be-ba2c-9b011c549033 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:04.918052 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:04.918819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.919027 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.919276 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.920264 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:04.920623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:04.923226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:04.948870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1337/2682] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:41:04.950085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28382-f973-42be-942e-9fb15df740ca None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:04.961172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28382-f973-42be-942e-9fb15df740ca None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:04.970115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:04.972575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:04.972575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:04.972575 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:04.972920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:04.976298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.019240 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1346/2683] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:04 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:05.022624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.038168 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7baeb-074e-42a7-8e3f-015b1ee98478 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.050341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:05.113058 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.113690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.113989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.114257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.114893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.116843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.145411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1338/2684] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:05 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:05.146220 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.156941 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703339-ca38-4241-83ce-b1b9bd46a481 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.161855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.162467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.162741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.163010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.163692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.165297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.176207 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1347/2685] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:05.180064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.191057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f8d9-ba22-436a-9a59-168d90590cba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.195660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.196288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.196560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.196823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.197467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.199039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc620eae-5dc4-47a0-8228-4b9c4ecec23e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.209787 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1339/2686] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:05.213973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.225289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c962-07ac-4803-a99a-cf0273213cc1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.230546 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.231340 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.231739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.232074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] PATH_INFO: `/v3/projects/253cb9ff97844543a3d4bf7e9cb8f21a/users/070424546cc6405ca2ecbc8414033d80/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.266680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253cb9ff97844543a3d4bf7e9cb8f21a, user_id=070424546cc6405ca2ecbc8414033d80, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.275178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.289368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1348/2687] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:05 2022] PUT /identity/v3/projects/253cb9ff97844543a3d4bf7e9cb8f21a/users/070424546cc6405ca2ecbc8414033d80/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:05.301218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.301218 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.301550 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.331368 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] MFA Rules not processed for user `070424546cc6405ca2ecbc8414033d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:05.332581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:05.417858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1340/2688] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:05.424937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.465696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:05.502729 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809cb19-3c8f-4372-a08c-ce5448651766 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.507737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.508436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.508783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.509122 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.509822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.511928 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.544540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1349/2689] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:05 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:05.548925 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.561725 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97defe4f-b686-4273-971a-a27f4addfcc4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.624247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.624877 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.625206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.625481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.626124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.628115 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.654334 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1341/2690] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:05 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:05.658477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.670250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b314cf-1799-4cba-b06e-f7082e51ffc7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.675660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.676422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.676810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.677339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.678075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.680016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.693075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1350/2691] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:05.697443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.709098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d224-83a0-4de6-bd4e-ee73948036ad admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.714430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.715434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.715816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.716185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] PATH_INFO: `/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f/users/0de65afc71c44c47b42e00863047675c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.726785 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:05.735446 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baef9eb0c4e24e0f92d1486d3a66db3f, user_id=0de65afc71c44c47b42e00863047675c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.738409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.758841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1342/2692] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:05 2022] PUT /identity/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f/users/0de65afc71c44c47b42e00863047675c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:05.760347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.772448 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb579315-6340-4c52-8333-2c300572f53e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.842276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.843298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.843676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.844051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.844815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.846610 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fd2ff-e416-4355-8565-fb7304f691be admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.858454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1351/2693] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:05.862776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:05.874588 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04415d-43bd-4976-977a-836e7ebad9e2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:05.880345 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:05.881129 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.881493 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.881827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] PATH_INFO: `/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f/users/0de65afc71c44c47b42e00863047675c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.884107 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baef9eb0c4e24e0f92d1486d3a66db3f, user_id=0de65afc71c44c47b42e00863047675c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:05.886864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:05.900086 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1343/2694] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:05 2022] PUT /identity/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f/users/0de65afc71c44c47b42e00863047675c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:05.910741 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:05.911858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:05.912455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:05.946490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] MFA Rules not processed for user `0de65afc71c44c47b42e00863047675c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:05.948124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.037927 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1352/2695] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:06.049220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:06.050961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.110561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1d3d1-947e-404d-8fbb-8c3482f126a5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:06.114316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:06.114939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:06.115243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:06.115521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:06.124842 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:06.126274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:06.135831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1344/2696] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:06.265712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:06.267170 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.320299 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:06.368561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c0a3a-37fc-4aac-9df5-945b89fe3ea6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:06.379368 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:06.380308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:06.380656 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:06.380992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:06.384012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.503155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:06.503155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83558a01-ad2d-4c86-a354-842353deebb9 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:06.515063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1353/2697] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:06.628617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:06.643817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d89c-4199-4c3b-a2a8-87e3e3475f27 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:06.649460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:06.650072 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:06.650349 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:06.651078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] PATH_INFO: `/v3/users/070424546cc6405ca2ecbc8414033d80` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:06.651814 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] RBAC: Authorizing `identity:delete_user(user_id=070424546cc6405ca2ecbc8414033d80)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:06.653999 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:06.705955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070424546cc6405ca2ecbc8414033d80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:06.706772 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070424546cc6405ca2ecbc8414033d80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:06.707519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070424546cc6405ca2ecbc8414033d80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:06.720410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070424546cc6405ca2ecbc8414033d80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:06.727771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070424546cc6405ca2ecbc8414033d80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:06.742559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1345/2698] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:06 2022] DELETE /identity/v3/users/070424546cc6405ca2ecbc8414033d80 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:06.747451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:06.747739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:06.748091 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:06.770298 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:06.771695 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.855180 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1354/2699] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:06.894411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:06.899306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:06.990215 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:06.997703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032a1f-2cf0-4aeb-94c7-a2bd4e25584d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:07.002986 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:07.003672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:07.003955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:07.004277 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:07.016396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:07.017855 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:07.036186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1346/2700] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:07.733231 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:07.734676 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:07.751239 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84061-90f6-456a-9abf-71f4b37669a0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:07.760129 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:07.760913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:07.761266 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:07.761605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] PATH_INFO: `/v3/projects/253cb9ff97844543a3d4bf7e9cb8f21a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:07.762833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253cb9ff97844543a3d4bf7e9cb8f21a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:07.764977 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:07.834911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253cb9ff97844543a3d4bf7e9cb8f21a', 'request_id': 'req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:07.842172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253cb9ff97844543a3d4bf7e9cb8f21a', 'request_id': 'req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:07.853412 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253cb9ff97844543a3d4bf7e9cb8f21a', 'request_id': 'req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:07.863075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:07.873566 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] The token cache is being invalidate because project 253cb9ff97844543a3d4bf7e9cb8f21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:07.874021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:07.875108 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:07.883016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1355/2701] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:07 2022] DELETE /identity/v3/projects/253cb9ff97844543a3d4bf7e9cb8f21a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:07.883252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:07.898071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e5037-76f8-4522-a801-c6648d742847 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:07.971975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:07.972920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:07.973360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:07.973769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] PATH_INFO: `/v3/users/0de65afc71c44c47b42e00863047675c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:07.975547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de65afc71c44c47b42e00863047675c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:07.978028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:08.047311 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de65afc71c44c47b42e00863047675c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.047700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de65afc71c44c47b42e00863047675c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.048623 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de65afc71c44c47b42e00863047675c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.064780 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de65afc71c44c47b42e00863047675c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.073341 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6193a26e-f57e-4e4c-866a-89f7f9f978c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de65afc71c44c47b42e00863047675c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.089143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1347/2702] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:07 2022] DELETE /identity/v3/users/0de65afc71c44c47b42e00863047675c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:08.723838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:08.725727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:08.748288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3ac9-d3b9-463a-a0dc-895446e5cc86 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:08.847380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:08.848153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:08.848640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:08.848981 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] PATH_INFO: `/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:08.851262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baef9eb0c4e24e0f92d1486d3a66db3f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:08.853773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:08.945506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baef9eb0c4e24e0f92d1486d3a66db3f', 'request_id': 'req-f6fc68c6-afe1-4b33-a16b-2f611688c321'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.953061 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baef9eb0c4e24e0f92d1486d3a66db3f', 'request_id': 'req-f6fc68c6-afe1-4b33-a16b-2f611688c321'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.964916 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baef9eb0c4e24e0f92d1486d3a66db3f', 'request_id': 'req-f6fc68c6-afe1-4b33-a16b-2f611688c321'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.976794 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] The token cache is being invalidate because project baef9eb0c4e24e0f92d1486d3a66db3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:08.977088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.977774 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f6fc68c6-afe1-4b33-a16b-2f611688c321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:08.979690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1356/2703] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:08 2022] DELETE /identity/v3/projects/baef9eb0c4e24e0f92d1486d3a66db3f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:08.984609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:08.985154 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:08.985529 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.013511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:09.017197 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:09.133266 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1348/2704] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:09.143907 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.146228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.146735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.170653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:09.171935 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:09.183681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1357/2705] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:09.185183 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.195831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1804-c79e-4e4b-bf7e-69f7f70a14a9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.200727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.201342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.201871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.202378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.203247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:09.203744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.205418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.212776 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:09.224640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.225077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1349/2706] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:41:09.236373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2836-ae75-4b73-8a78-3563a41a9989 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.246378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.247128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.247506 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.247851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.248782 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.256715 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.323476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1358/2707] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:09 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:09.328955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.344515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0465-e295-4403-a468-1c2e19975332 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.445881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.447128 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.447445 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.447728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.449833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.452024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.511616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1350/2708] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:09 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:09.515987 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.528778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d59f-1770-47dd-b436-9ded4460ec3d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.533706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.534310 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.534583 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.534849 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.535540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.537140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.547885 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1359/2709] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:09.552371 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.564414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca20665-1085-4533-aa05-8a9e80d0caf1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.569575 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.569824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.570109 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.570386 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.571046 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.573120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227c65-df22-491d-a29a-771d3ceddb85 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.588390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1351/2710] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:09.594982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.614969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfcee4-8e45-4815-adb8-bfd009f0115b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.621654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.621654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.621968 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.622214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] PATH_INFO: `/v3/projects/fc9aa979dce440e8bdf5edc839e23cda/users/1bf477b66c114a8bba24d303b4098769/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.641234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9aa979dce440e8bdf5edc839e23cda, user_id=1bf477b66c114a8bba24d303b4098769, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.644102 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.664222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1360/2711] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:09 2022] PUT /identity/v3/projects/fc9aa979dce440e8bdf5edc839e23cda/users/1bf477b66c114a8bba24d303b4098769/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:09.674552 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.674875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.675123 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.707709 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] MFA Rules not processed for user `1bf477b66c114a8bba24d303b4098769`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:09.709045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:09.795410 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1352/2712] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:09.808395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:09.811383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:09.849982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:09.892669 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534af2d-e38c-4962-842a-db431f5bf84a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:09.896772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:09.897442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:09.897868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:09.898150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:09.916815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:09.918438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:09.942870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1361/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:10.734489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:10.737337 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:10.830799 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df457-8c82-4116-a00f-db156ef801f6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:10.835617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:10.836262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:10.836534 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:10.836803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] PATH_INFO: `/v3/users/26adbd5487f0466d9b36adc4d6f768dc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:10.837942 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26adbd5487f0466d9b36adc4d6f768dc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:10.839916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:10.846073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:10.890284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26adbd5487f0466d9b36adc4d6f768dc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:10.891039 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26adbd5487f0466d9b36adc4d6f768dc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:10.891704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26adbd5487f0466d9b36adc4d6f768dc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:10.904213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26adbd5487f0466d9b36adc4d6f768dc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:10.911487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fc3dd958-3234-48a4-81d5-064b47f170dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26adbd5487f0466d9b36adc4d6f768dc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:10.925853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1353/2714] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:10 2022] DELETE /identity/v3/users/26adbd5487f0466d9b36adc4d6f768dc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:11.209666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.232596 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3277b8-1090-4642-812e-4115fdcb3aaf service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.327851 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.328532 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.328939 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.329214 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] PATH_INFO: `/v3/projects/ce361cbc0fa34c7986e495b4fbf510e1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.330409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce361cbc0fa34c7986e495b4fbf510e1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.332383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.406217 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce361cbc0fa34c7986e495b4fbf510e1', 'request_id': 'req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.414008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce361cbc0fa34c7986e495b4fbf510e1', 'request_id': 'req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.437144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce361cbc0fa34c7986e495b4fbf510e1', 'request_id': 'req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.452707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] The token cache is being invalidate because project ce361cbc0fa34c7986e495b4fbf510e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:11.453358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.454249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e1e35ed-6e73-4abe-8172-6f8ce6c37435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.456156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1362/2715] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:11 2022] DELETE /identity/v3/projects/ce361cbc0fa34c7986e495b4fbf510e1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:11.461093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.461719 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.462004 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.505843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:11.507732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:11.616653 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1354/2716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:11.625758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.626343 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.626823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.652796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:11.654422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:11.664124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1363/2717] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:11.668816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.684766 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d9433-a044-4806-afe4-313052b8eae9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.690528 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.691088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.691421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.691771 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.692592 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:11.692898 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.694675 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.713620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1355/2718] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:41:11.719118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.732858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368d31-2833-4de1-a0e3-c82aabb27ea3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.737498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.738115 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.738388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.738653 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.739364 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.741464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.763121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.765923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:11.785356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1364/2719] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:11 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:11.789857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.790044 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413d133-e1fb-4c3c-8461-0b68b63cefd4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.831555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:11.855489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.856242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.856589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.856924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] PATH_INFO: `/v3/users/e774f9d4502845c8a8df321ced32b1f3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.858236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e774f9d4502845c8a8df321ced32b1f3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.860289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.864724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652226-e726-46e9-a3cf-d46f5c6caefc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.869451 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.870066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.870357 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.870702 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.871362 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.873773 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.876924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:11.898329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1365/2720] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:11 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:11.903624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.915156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a918-55cb-4c43-bbec-487798119ff2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:11.916833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e774f9d4502845c8a8df321ced32b1f3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.917578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e774f9d4502845c8a8df321ced32b1f3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.918297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e774f9d4502845c8a8df321ced32b1f3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.921098 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:11.921949 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:11.922316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:11.922675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:11.923700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:11.925721 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:11.932284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e774f9d4502845c8a8df321ced32b1f3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.936121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1366/2721] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:11.939676 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e774f9d4502845c8a8df321ced32b1f3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:11.940423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:11.942148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:11.953413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1356/2722] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:11 2022] DELETE /identity/v3/users/e774f9d4502845c8a8df321ced32b1f3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:11.954588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca990bd7-faa8-4389-8ddf-ecd3b961ec89 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.018654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.019378 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.019657 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.019957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.020616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.022307 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c2d63-d17b-412a-9e35-098f257ad859 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.034801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1367/2723] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:12.040633 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:12.051531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93950-81b4-4912-9952-b8a0649c4937 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.056460 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.057139 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.057419 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.057690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] PATH_INFO: `/v3/projects/24cc1b55dcae43a59788b4ca5176d109/users/6eac1addb1504721bac92ac59391821d/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.075243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cc1b55dcae43a59788b4ca5176d109, user_id=6eac1addb1504721bac92ac59391821d, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.078083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.091968 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1357/2724] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:12 2022] PUT /identity/v3/projects/24cc1b55dcae43a59788b4ca5176d109/users/6eac1addb1504721bac92ac59391821d/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:12.097156 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.097430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.097703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.117957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:12.119226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:12.141883 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:12.143826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:12.192813 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1368/2725] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:12.203017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:12.204706 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:12.211111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7e6a4-4dba-4945-acb0-fe12ac2c268a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.216064 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.216728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.217001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.217265 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] PATH_INFO: `/v3/projects/c460e54b9c8e400f9b14942f3fc7d695` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.218478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c460e54b9c8e400f9b14942f3fc7d695)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.220409 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.259663 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:12.266481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929432-5de8-4ae8-9d36-e926842cc67f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.267945 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c460e54b9c8e400f9b14942f3fc7d695', 'request_id': 'req-2b37046f-91c5-406c-908c-90decc2cf379'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.275210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c460e54b9c8e400f9b14942f3fc7d695', 'request_id': 'req-2b37046f-91c5-406c-908c-90decc2cf379'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.283612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c460e54b9c8e400f9b14942f3fc7d695', 'request_id': 'req-2b37046f-91c5-406c-908c-90decc2cf379'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.290834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:12.297247 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] The token cache is being invalidate because project c460e54b9c8e400f9b14942f3fc7d695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:12.297554 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.298618 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.301645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1358/2726] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:12 2022] DELETE /identity/v3/projects/c460e54b9c8e400f9b14942f3fc7d695 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:12.306056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:12.307572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:12.322489 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.323429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.323703 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.323969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.325696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:12.373704 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37046f-91c5-406c-908c-90decc2cf379 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.379481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.380252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.380608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.380976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] PATH_INFO: `/v3/users/73384f8e6ac94c63bc2ce995aeda643f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.382223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73384f8e6ac94c63bc2ce995aeda643f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.384206 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.389816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.392053 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.402052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1369/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:41:12.441471 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73384f8e6ac94c63bc2ce995aeda643f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.442192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73384f8e6ac94c63bc2ce995aeda643f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.442907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73384f8e6ac94c63bc2ce995aeda643f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.455061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73384f8e6ac94c63bc2ce995aeda643f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.462648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73384f8e6ac94c63bc2ce995aeda643f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.477532 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1359/2728] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:12 2022] DELETE /identity/v3/users/73384f8e6ac94c63bc2ce995aeda643f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:12.823434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:12.837850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873064-6333-4851-ba86-0e13e65f449e service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:12.923225 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:12.923888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:12.924163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:12.924483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] PATH_INFO: `/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:12.925607 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a9ec1731b14d7f9a812c1acf328aee)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:12.927570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:12.991150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a9ec1731b14d7f9a812c1acf328aee', 'request_id': 'req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:12.998099 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a9ec1731b14d7f9a812c1acf328aee', 'request_id': 'req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:13.000430 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:13.008913 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a9ec1731b14d7f9a812c1acf328aee', 'request_id': 'req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:13.022762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] The token cache is being invalidate because project f9a9ec1731b14d7f9a812c1acf328aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:13.023055 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:13.023783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d8625d3c-fc29-4d38-9a82-4bdb9dd85dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:13.025545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1370/2729] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:12 2022] DELETE /identity/v3/projects/f9a9ec1731b14d7f9a812c1acf328aee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:15.910136 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:15.912553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:15.932454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d703c-3b2f-4da7-a777-284cf9be4156 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:16.008093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:16.008972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.009359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.009721 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] PATH_INFO: `/v3/users/1bf477b66c114a8bba24d303b4098769` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.012019 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf477b66c114a8bba24d303b4098769)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:16.014185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:16.043523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:16.077586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf477b66c114a8bba24d303b4098769'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.078539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf477b66c114a8bba24d303b4098769'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.079288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf477b66c114a8bba24d303b4098769'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.097113 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf477b66c114a8bba24d303b4098769'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.106657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf477b66c114a8bba24d303b4098769'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.125302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1360/2730] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:15 2022] DELETE /identity/v3/users/1bf477b66c114a8bba24d303b4098769 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:16.129952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.130705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.130705 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.153503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:16.154664 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.226274 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1371/2731] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:16.242174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:16.244212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.315087 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763c83-adbe-4c03-ad13-0f3673f3271d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:16.320444 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:16.321082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.321362 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.321681 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.333657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:16.335236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9ce95-a26d-4f96-98bc-abdad903136a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:16.346775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1361/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:16.686383 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:16.688498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.711381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb8925-9f0c-4b38-9c34-47fa95170077 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:16.717198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:16.718380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.718753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.719121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] PATH_INFO: `/v3/projects/fc9aa979dce440e8bdf5edc839e23cda` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.720719 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9aa979dce440e8bdf5edc839e23cda)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:16.723026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:16.790837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.791045 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.791328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.798494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9aa979dce440e8bdf5edc839e23cda', 'request_id': 'req-0e521da0-d5dd-41c6-868b-f9a5e56872f3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.805685 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9aa979dce440e8bdf5edc839e23cda', 'request_id': 'req-0e521da0-d5dd-41c6-868b-f9a5e56872f3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.819275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9aa979dce440e8bdf5edc839e23cda', 'request_id': 'req-0e521da0-d5dd-41c6-868b-f9a5e56872f3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.827074 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] MFA Rules not processed for user `6eac1addb1504721bac92ac59391821d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:16.828563 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.832215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] The token cache is being invalidate because project fc9aa979dce440e8bdf5edc839e23cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:16.832508 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.833316 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0e521da0-d5dd-41c6-868b-f9a5e56872f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:16.835969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1372/2733] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:16 2022] DELETE /identity/v3/projects/fc9aa979dce440e8bdf5edc839e23cda => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:16.841382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca191-9b60-44b6-9804-f555c6fc87bd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.841382 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca191-9b60-44b6-9804-f555c6fc87bd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.841674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca191-9b60-44b6-9804-f555c6fc87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.864308 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-726ca191-9b60-44b6-9804-f555c6fc87bd None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:16.865611 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-726ca191-9b60-44b6-9804-f555c6fc87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.906010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1362/2734] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:41:16.922193 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:16.923517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:16.935376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1373/2735] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:16.939083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:16.939505 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:16.939603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:16.982952 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:16.985809 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:16.989752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:16.991177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:17.001095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1374/2736] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:41:17.005392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.020647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abc4fe-ba8b-4f64-8c30-b95f64a914b5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.027408 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.028203 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.028558 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.028900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.029642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:17.030090 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.032076 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.044728 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70527de2-159b-4b2a-9b84-a6914731b2f6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.046041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1375/2737] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:41:17.050317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.052900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.053750 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.054239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.054578 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.061810 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033bb-acd7-45e9-9faa-aa1b2b0c62c4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.066975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.067166 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.067628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.067903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.068172 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.068800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.068957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.070690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.080288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1363/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:41:17.103268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1376/2739] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:17.107180 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.118649 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571be58a-1ac0-45f3-a6e8-5583db422547 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.190746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.191579 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.191919 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.192251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.192957 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.194950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.219251 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1364/2740] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:17 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:17.223956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.237230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855a65-191e-4ec6-ad33-9b04a6a0ae8a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.244215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.245078 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.245491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.245853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.246734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.248866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.278428 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1377/2741] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:17.282144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.294336 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f36ee-cf54-49ea-a724-4b06939c18b1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.300500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.301217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.301496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.301762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.302426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.311227 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed2ef9-4b48-4e25-962f-2b849ea20218 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.330411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1365/2742] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:17.335352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.351771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2655aa5-dada-4e87-976d-a6b93c42cb31 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.357646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.358762 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.359238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.360588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] PATH_INFO: `/v3/projects/fc67112c0fe1420aa7c4395c63ec02f0/users/c34f22dc3b4e486da8496a999194d410/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.382020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc67112c0fe1420aa7c4395c63ec02f0, user_id=c34f22dc3b4e486da8496a999194d410, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.386230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.408658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1378/2743] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:17 2022] PUT /identity/v3/projects/fc67112c0fe1420aa7c4395c63ec02f0/users/c34f22dc3b4e486da8496a999194d410/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:17.486894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.487234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.487502 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.547690 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] MFA Rules not processed for user `c34f22dc3b4e486da8496a999194d410`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:17.549243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:17.646613 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1366/2744] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:17.651024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.752335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f071-88ad-4be2-9b7e-e70e444311b5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.765802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.766463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.766739 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.767016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.768050 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.769997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.808545 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1379/2745] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:17.812262 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.825500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326ee9-1f06-4d9b-bd0c-9e79aa47f5ec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.851853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:17.897948 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.898587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.898863 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.899130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.899852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.901867 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.928701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1367/2746] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:17 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:17.929522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.941805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cb95e-2ddd-4847-b926-347aa59d463f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.947461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.948205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.948205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.948445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.949213 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.950888 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.962687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1380/2747] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:17.966735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:17.977236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a028-33e8-4274-89e3-879ab44285f3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:17.983305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:17.983984 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:17.984255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:17.984522 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:17.985182 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:17.986819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dd111-784a-4101-a8ce-6f0a252e2986 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:17.997901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1368/2748] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:18.002350 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.013465 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c8149-d0a4-4f70-9cca-c41fa0599d59 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.019993 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.020710 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.020990 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.021265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] PATH_INFO: `/v3/projects/ff638543f3344f9bb53ab09fa75ff78d/users/066fca3ff6bb4c718196f95df51eeb80/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.043733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff638543f3344f9bb53ab09fa75ff78d, user_id=066fca3ff6bb4c718196f95df51eeb80, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.046582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.062173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1381/2749] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:18 2022] PUT /identity/v3/projects/ff638543f3344f9bb53ab09fa75ff78d/users/066fca3ff6bb4c718196f95df51eeb80/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:18.072971 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.073257 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.073541 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.106732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] MFA Rules not processed for user `066fca3ff6bb4c718196f95df51eeb80`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:18.107791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:18.185049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1369/2750] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:41:18.190236 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.243556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:18.267522 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc527c-aa8d-4f36-bc63-b75fda17909e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.272420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.273045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.273317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.273582 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.274222 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.276158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.306831 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1382/2751] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:18.308060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.321289 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aea38-fc1d-4715-a332-d257a35ecadb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.381824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.382474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.382775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.383075 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.383754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.385657 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.409974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1370/2752] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:18 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:41:18.413938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.429020 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b564dcb-3006-491e-81c1-7ed11ecdaeb9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.434481 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.435000 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.435317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.435629 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.436377 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.438325 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.455373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1383/2753] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:18.458487 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.469124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d55d7b-684a-4259-a687-d72556b84f0f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.473660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.474329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.474602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.474873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] PATH_INFO: `/v3/projects/3aeb773330734b8fac46a2b537cd1cf9/users/d08d8a284ec04cfc9e07a21f23f3d639/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.489831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aeb773330734b8fac46a2b537cd1cf9, user_id=d08d8a284ec04cfc9e07a21f23f3d639, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.492521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.495670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:18.507843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1371/2754] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:18 2022] PUT /identity/v3/projects/3aeb773330734b8fac46a2b537cd1cf9/users/d08d8a284ec04cfc9e07a21f23f3d639/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:18.512010 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.522904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb924-adea-45ee-aa7e-a4c67ab055a8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.585712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.586328 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.586599 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.586867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.587549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.589150 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1f9dc-bc05-44a4-9be0-8dfbcab5e0a6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.600353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1384/2755] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:18.604121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.616293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a8381-9a30-43cd-b8c7-e704a16252d6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.621723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.622463 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.622706 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.622979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] PATH_INFO: `/v3/projects/3aeb773330734b8fac46a2b537cd1cf9/users/d08d8a284ec04cfc9e07a21f23f3d639/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.624998 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aeb773330734b8fac46a2b537cd1cf9, user_id=d08d8a284ec04cfc9e07a21f23f3d639, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.627821 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404dc98-8875-4825-afaf-2654966bac59 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.631694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.632002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.632275 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.648530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1372/2756] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:18 2022] PUT /identity/v3/projects/3aeb773330734b8fac46a2b537cd1cf9/users/d08d8a284ec04cfc9e07a21f23f3d639/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:18.650076 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.650370 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.650631 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.654079 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] MFA Rules not processed for user `6eac1addb1504721bac92ac59391821d`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:18.655334 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:18.681078 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] MFA Rules not processed for user `d08d8a284ec04cfc9e07a21f23f3d639`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:18.682635 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:18.718812 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1385/2757] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:18.760372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1373/2758] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:18.772492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:18.773983 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:18.844105 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443498c4-c15f-435d-b8ef-9c4a6e5488a6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:18.848030 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:18.848775 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:18.849120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:18.849455 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:18.859655 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:18.912871 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:18.914475 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:18.925868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1386/2759] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:20.522202 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:20.523905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:20.538820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fb78f-193a-4e10-8eba-458bdadeefb4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:20.542783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:20.543453 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:20.543726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:20.543991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:20.622956 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:20.624997 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:20.641396 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1374/2760] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:21.316801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:21.330665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce4db-64f1-4b44-9b8d-53f74dac3930 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:21.335633 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:21.337067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:21.337303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:21.337567 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:21.351255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:21.352770 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392a9e5-dd50-4a90-a32b-ed6bb8db7dff service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:21.363324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1387/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 19:41:25.377818 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:25.448955 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39fc2-6d30-4f37-9a3e-babe0531fbac service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:25.453894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:25.454664 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:25.455007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:25.455350 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] PATH_INFO: `/v3/users/c34f22dc3b4e486da8496a999194d410` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:25.456549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34f22dc3b4e486da8496a999194d410)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:25.458557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:25.464816 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:25.509229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34f22dc3b4e486da8496a999194d410'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:25.509800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34f22dc3b4e486da8496a999194d410'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:25.510393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34f22dc3b4e486da8496a999194d410'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:25.521722 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34f22dc3b4e486da8496a999194d410'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:25.528280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34f22dc3b4e486da8496a999194d410'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:25.541353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1375/2762] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:25 2022] DELETE /identity/v3/users/c34f22dc3b4e486da8496a999194d410 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:25.546011 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:25.546528 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:25.546698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:25.567018 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:25.568286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:25.644499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1388/2763] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:25.655804 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:25.657595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:25.717749 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f723-6bd3-4585-b155-516fd8db610f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:25.721860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:25.722474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:25.722763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:25.723034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:25.732207 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:25.733683 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:25.743369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1376/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:26.056420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:26.058051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:26.071711 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e02fe-2173-4732-bed2-6bcb85d88c27 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:26.076901 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:26.077549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:26.077961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:26.078238 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] PATH_INFO: `/v3/projects/fc67112c0fe1420aa7c4395c63ec02f0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:26.079605 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc67112c0fe1420aa7c4395c63ec02f0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:26.081535 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:26.133192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc67112c0fe1420aa7c4395c63ec02f0', 'request_id': 'req-dda759ad-1088-4b6f-a49a-4a8f52e8e465'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.139946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc67112c0fe1420aa7c4395c63ec02f0', 'request_id': 'req-dda759ad-1088-4b6f-a49a-4a8f52e8e465'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.148463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc67112c0fe1420aa7c4395c63ec02f0', 'request_id': 'req-dda759ad-1088-4b6f-a49a-4a8f52e8e465'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.159419 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] The token cache is being invalidate because project fc67112c0fe1420aa7c4395c63ec02f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:26.159840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.160503 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.162110 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1389/2765] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:26 2022] DELETE /identity/v3/projects/fc67112c0fe1420aa7c4395c63ec02f0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:26.166226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:26.176119 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978715e-adab-4082-8526-fd693228b283 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:26.236347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:26.237523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:26.237523 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:26.237773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] PATH_INFO: `/v3/users/066fca3ff6bb4c718196f95df51eeb80` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:26.239134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066fca3ff6bb4c718196f95df51eeb80)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:26.241096 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:26.281430 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:26.296398 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066fca3ff6bb4c718196f95df51eeb80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.297216 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066fca3ff6bb4c718196f95df51eeb80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.297886 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066fca3ff6bb4c718196f95df51eeb80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.319433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066fca3ff6bb4c718196f95df51eeb80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.327735 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066fca3ff6bb4c718196f95df51eeb80'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.343094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1377/2766] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:26 2022] DELETE /identity/v3/users/066fca3ff6bb4c718196f95df51eeb80 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:26.644005 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:26.645626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:26.663499 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda759ad-1088-4b6f-a49a-4a8f52e8e465 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:26.680815 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:26.725344 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:26.726074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:26.726355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:26.726630 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] PATH_INFO: `/v3/projects/ff638543f3344f9bb53ab09fa75ff78d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:26.727878 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff638543f3344f9bb53ab09fa75ff78d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:26.729876 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:26.779167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff638543f3344f9bb53ab09fa75ff78d', 'request_id': 'req-a6dc15ed-78ab-4527-8d52-1a99a25c0867'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.785658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff638543f3344f9bb53ab09fa75ff78d', 'request_id': 'req-a6dc15ed-78ab-4527-8d52-1a99a25c0867'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.793467 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff638543f3344f9bb53ab09fa75ff78d', 'request_id': 'req-a6dc15ed-78ab-4527-8d52-1a99a25c0867'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.805100 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] The token cache is being invalidate because project ff638543f3344f9bb53ab09fa75ff78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:26.805511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.806388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.808052 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1390/2767] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:26 2022] DELETE /identity/v3/projects/ff638543f3344f9bb53ab09fa75ff78d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:41:26.812143 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:26.813980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:26.827244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d91f-2ebe-456c-a80b-8ebca73fcc52 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:26.886185 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:26.886838 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:26.887092 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:26.887401 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] PATH_INFO: `/v3/users/d08d8a284ec04cfc9e07a21f23f3d639` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:26.888557 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08d8a284ec04cfc9e07a21f23f3d639)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:26.890508 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:26.938791 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08d8a284ec04cfc9e07a21f23f3d639'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.939476 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08d8a284ec04cfc9e07a21f23f3d639'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.940084 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08d8a284ec04cfc9e07a21f23f3d639'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.951727 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08d8a284ec04cfc9e07a21f23f3d639'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.958327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-53e157cf-f90d-4343-8fd9-787e1d401481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08d8a284ec04cfc9e07a21f23f3d639'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:26.971939 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1378/2768] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:26 2022] DELETE /identity/v3/users/d08d8a284ec04cfc9e07a21f23f3d639 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:27.253144 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.254826 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:27.273014 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc15ed-78ab-4527-8d52-1a99a25c0867 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.332823 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.333484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.333760 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.334046 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] PATH_INFO: `/v3/projects/3aeb773330734b8fac46a2b537cd1cf9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.335179 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aeb773330734b8fac46a2b537cd1cf9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.337167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.386146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aeb773330734b8fac46a2b537cd1cf9', 'request_id': 'req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:27.388392 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:27.393690 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aeb773330734b8fac46a2b537cd1cf9', 'request_id': 'req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:27.403825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aeb773330734b8fac46a2b537cd1cf9', 'request_id': 'req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:27.415861 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] The token cache is being invalidate because project 3aeb773330734b8fac46a2b537cd1cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:27.416243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:27.416884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3fc648bf-4099-4aa7-93b1-34ba1eb3f6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:27.418805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1391/2769] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:27 2022] DELETE /identity/v3/projects/3aeb773330734b8fac46a2b537cd1cf9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:27.426213 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.426576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.426841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.447309 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:27.448509 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:27.468798 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:27.515012 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1379/2770] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:27.523045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.523371 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.523645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.545450 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:27.546673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:27.555603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1392/2771] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:27.560210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.571306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143789-dc09-4b58-9da1-a5183443e6e8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.576393 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.577009 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.577293 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.577569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.578411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:41:27.578726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.580744 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.593589 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1380/2772] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:41:27.597999 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.607476 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dc9a6-76a5-48ca-b06c-a689250a1b2b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.612277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.612894 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.613160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.613381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.613995 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.615966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.644947 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1393/2773] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:27.649280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.659372 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d20660-d2cd-4b49-930f-4fe9cf816b61 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.718244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.718859 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.719130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.719426 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.720175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.722069 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.745651 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1381/2774] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:41:27 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:41:27.750130 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.760763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d1476-463f-40c7-ab1d-9b3dfc69b103 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.766095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.766698 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.766966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.767267 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.768012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.769603 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.780155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1394/2775] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:41:27.784249 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.794710 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775fbf9-e20b-430e-bb66-158034873bfb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.800025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.800630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.800897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.801170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.801825 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.803478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d446a-0b87-488f-9eef-298d2ffd8fb2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.815841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1382/2776] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 19:41:27.820064 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:27.830723 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712267b-bbcc-4427-9821-81933c12b19b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:27.840936 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:27.841618 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.841895 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.842168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] PATH_INFO: `/v3/projects/f61d41814cbf420e9812562357ec058b/users/cede7bb1564045f2a1cdac9edab0fdde/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.857973 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61d41814cbf420e9812562357ec058b, user_id=cede7bb1564045f2a1cdac9edab0fdde, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:27.860818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:27.875060 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1395/2777] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:41:27 2022] PUT /identity/v3/projects/f61d41814cbf420e9812562357ec058b/users/cede7bb1564045f2a1cdac9edab0fdde/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:27.886117 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:27.886404 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:27.886678 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:27.916759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] MFA Rules not processed for user `cede7bb1564045f2a1cdac9edab0fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:27.917927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:27.993411 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1383/2778] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:28.007176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:28.010083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:28.076624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693de1c-dbe3-48ae-8e29-01d632558995 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:28.080604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:28.081215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:28.081490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:28.081763 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:28.091063 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:28.092570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67602-93da-4a66-8463-f1e2e2db70bb service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:28.102445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1396/2779] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:30.693560 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:30.723669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:30.763231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc03d-e2fc-415f-a07f-f1ad74e7ed48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:30.768281 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:30.768918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:30.769192 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:30.769461 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] PATH_INFO: `/v3/users/cede7bb1564045f2a1cdac9edab0fdde` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:30.770617 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cede7bb1564045f2a1cdac9edab0fdde)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:30.772586 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:30.835822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cede7bb1564045f2a1cdac9edab0fdde'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:30.836712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cede7bb1564045f2a1cdac9edab0fdde'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:30.837542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cede7bb1564045f2a1cdac9edab0fdde'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:30.855177 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cede7bb1564045f2a1cdac9edab0fdde'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:30.862581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cede7bb1564045f2a1cdac9edab0fdde'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:30.877667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1384/2780] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:41:30 2022] DELETE /identity/v3/users/cede7bb1564045f2a1cdac9edab0fdde => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:30.882687 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:30.883242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:30.883242 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:30.949886 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:41:30.951012 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:31.001206 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:31.067369 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1397/2781] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:41:31.075707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:31.077421 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:31.161470 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3b39-12a0-4314-9589-7637ec194210 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:31.165316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:31.165930 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:31.166210 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:31.166511 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:31.175827 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:31.177300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:31.186974 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1385/2782] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:31.476006 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:31.477587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:31.497937 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736352-010a-4e0b-8d4c-f35598b9698f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:31.511612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:31.512283 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:31.512548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:31.512821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] PATH_INFO: `/v3/projects/f61d41814cbf420e9812562357ec058b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:31.513970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61d41814cbf420e9812562357ec058b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:31.515944 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:31.567205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61d41814cbf420e9812562357ec058b', 'request_id': 'req-453a88d7-39d1-450b-84c8-90bd52e04ee9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:31.573785 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61d41814cbf420e9812562357ec058b', 'request_id': 'req-453a88d7-39d1-450b-84c8-90bd52e04ee9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:31.582026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61d41814cbf420e9812562357ec058b', 'request_id': 'req-453a88d7-39d1-450b-84c8-90bd52e04ee9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:31.593106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] The token cache is being invalidate because project f61d41814cbf420e9812562357ec058b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:41:31.593469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:31.594178 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-453a88d7-39d1-450b-84c8-90bd52e04ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:41:31.596085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1398/2783] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:41:31 2022] DELETE /identity/v3/projects/f61d41814cbf420e9812562357ec058b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:41:41.182569 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:41.590088 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:41:42.523124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:41:42.524900 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:42.626880 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fb4-bf8b-464c-a0f0-daa31abe184e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:41:42.703437 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:41:42.703969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:41:42.704220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:41:42.704521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:41:42.706697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:41:42.720548 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:41:42.722175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8155-4ea7-4160-9ea2-b3baebe6b37d service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:41:42.732608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1386/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:41:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:41:52.728134 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=67 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:42:13.964665 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:42:13.965261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:42:13.965261 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:42:13.985436 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] MFA Rules not processed for user `6eac1addb1504721bac92ac59391821d`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:42:13.986694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:42:14.046393 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1399/2785] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:42:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:42:24.039118 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=25 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:43:20.143382 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:43:20.143934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:43:20.143934 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:43:20.163238 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] MFA Rules not processed for user `6eac1addb1504721bac92ac59391821d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:43:20.164442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:43:20.172022 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1387/2786] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:43:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:43:30.157790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:44:13.573969 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:44:13.576396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:13.670825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74aa57-991e-4866-81cb-9b61a0426bb6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:44:13.674992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:44:13.675696 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:13.675966 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:13.676253 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:13.678297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:13.786808 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:44:13.789045 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df6a0f-3c78-4af7-a896-ed0c24f0d620 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:44:13.810670 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1400/2787] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:44:16.376241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:44:16.378520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:16.398305 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6bbce-7765-492a-b19f-7e16e0042f4e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:44:16.404765 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:44:16.405380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:16.405648 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:16.405912 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:16.408055 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:16.422283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:44:16.423743 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:44:16.435559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1388/2788] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:44:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:44:23.807432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=75 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:44:24.820277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:24.820926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:24.820926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:24.841460 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] MFA Rules not processed for user `6eac1addb1504721bac92ac59391821d`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:44:24.842818 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:24.851324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1401/2789] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:44:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:44:26.429973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:44:27.892071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:44:27.893976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:27.980540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3e46-689f-4df8-bb16-0118aad35442 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:44:27.984661 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:44:27.985286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:27.985561 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:27.985826 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:27.988085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:27.998475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:44:28.000007 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:44:28.008253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1389/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:44:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:44:28.590591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:44:28.592140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:28.612138 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdeef6-090b-4e7d-a173-433146e8d0f5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:44:28.618541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:44:28.619286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:28.619564 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:28.619833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:28.621623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:28.637070 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:44:28.639083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:44:28.651580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1402/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:44:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:44:37.521964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:44:37.535734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6f19-c65b-4748-9324-3efac2e700e1 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:44:37.541723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31fcd522972b4af7ab786a11af6938f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:44:37.542332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:44:37.542632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:44:37.542946 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:44:37.544815 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:44:37.558228 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:44:37.559851 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:44:37.571572 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1390/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:44:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:44:38.645797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=9 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:44:47.565962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=41 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:26.788589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:26.790047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:26.855914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059467b0-db10-4088-85e8-bdd27e43952e service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:26.860537 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:26.861234 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:26.861516 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:26.861791 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] PATH_INFO: `/v3/users/6eac1addb1504721bac92ac59391821d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:26.862930 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eac1addb1504721bac92ac59391821d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:26.864943 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:26.913167 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eac1addb1504721bac92ac59391821d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:26.913825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eac1addb1504721bac92ac59391821d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:26.914434 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eac1addb1504721bac92ac59391821d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:26.921395 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eac1addb1504721bac92ac59391821d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:26.933708 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-61b49eff-bb93-4259-92da-4a46fdc8ca7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eac1addb1504721bac92ac59391821d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:26.949021 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1403/2793] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:26 2022] DELETE /identity/v3/users/6eac1addb1504721bac92ac59391821d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:27.152862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.163969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d57f9-df20-4d12-bc2e-b16d52aee952 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.223680 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.224360 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.224640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.224907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] PATH_INFO: `/v3/projects/24cc1b55dcae43a59788b4ca5176d109` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.226041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cc1b55dcae43a59788b4ca5176d109)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.228008 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.281813 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cc1b55dcae43a59788b4ca5176d109', 'request_id': 'req-e787bbb5-fc35-4004-8f82-352ac1fddda1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:27.288347 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cc1b55dcae43a59788b4ca5176d109', 'request_id': 'req-e787bbb5-fc35-4004-8f82-352ac1fddda1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:27.297172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cc1b55dcae43a59788b4ca5176d109', 'request_id': 'req-e787bbb5-fc35-4004-8f82-352ac1fddda1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:27.308060 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] The token cache is being invalidate because project 24cc1b55dcae43a59788b4ca5176d109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:27.308346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:27.308961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e787bbb5-fc35-4004-8f82-352ac1fddda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:27.310500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1391/2794] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:27 2022] DELETE /identity/v3/projects/24cc1b55dcae43a59788b4ca5176d109 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:27.316752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.317057 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.317338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.377176 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:27.378352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:27.446747 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:27.460838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1404/2795] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:27.469888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.470170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.470442 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.490723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:27.491993 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:27.500051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1392/2796] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:27.504666 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.515205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c6fb5-c32d-4e8e-91fc-8d578a663bb6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.519963 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.520569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.520846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.521121 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.521781 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:45:27.522123 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.523802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.535970 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1405/2797] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:45:27.540418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.549834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f7e95-8857-4017-8f03-78a94820469d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.556392 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.557219 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.557530 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.557978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.558662 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.561297 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.602879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1393/2798] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:27.607230 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.618496 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915d00-6aa3-4527-a3c9-c0fdd2d4268e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.684884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.685617 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.685821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.686101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.686745 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.688779 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.712923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1406/2799] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:45:27.716853 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.728220 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2fdb7-9014-49ba-9e55-e9d2d3de2065 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.734028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.734696 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.735037 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.735361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.736010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.737604 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.748858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1394/2800] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:27.753358 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.765442 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278d6a4-8861-46d9-bccf-2f030ae8a4e2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.770484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.771114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.771409 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.771679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.772805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.774411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce082ab-5a28-4c4e-9989-c530defc1afb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.786092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1407/2801] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:27.790979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.801456 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cbbb4-685c-41ad-8063-6e42e96155eb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:27.807363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:27.808056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.808328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.808591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] PATH_INFO: `/v3/projects/15562659fec94b15861552aded1c0c41/users/b3ee8f0a7f304a94b93c801ea991dd6f/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.825355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15562659fec94b15861552aded1c0c41, user_id=b3ee8f0a7f304a94b93c801ea991dd6f, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:27.828073 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:27.843535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1395/2802] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:27 2022] PUT /identity/v3/projects/15562659fec94b15861552aded1c0c41/users/b3ee8f0a7f304a94b93c801ea991dd6f/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:45:27.855256 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:27.855837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:27.855837 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:27.887391 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] MFA Rules not processed for user `b3ee8f0a7f304a94b93c801ea991dd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:27.888722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:27.961272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1408/2803] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:27.966342 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:27.987492 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:28.043059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7416-ee69-4a49-ae85-9cf4c40a7de4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.049737 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.050357 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.050636 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.050905 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.051577 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.053503 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.086778 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1396/2804] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:27 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:28.092580 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.104917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d6f1-6afd-4f41-bda7-76ffdcc771e4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.157329 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:28.169093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.169722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.170002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.170277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.170908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.172971 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.196047 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1409/2805] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:28 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:28.200221 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.210773 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf578323-3eec-4a3c-aec8-aacd950312d0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.216481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.217083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.217355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.217634 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.218260 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.219960 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.231536 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1397/2806] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:28.235731 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.246604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd618-a13e-41e7-94f6-5fbc060e0ed0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.252478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.253157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.253432 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.253692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] PATH_INFO: `/v3/projects/e7ad8ffdf11c4701a47be49c2364b276/users/e65a266892ec4f25abbf4fa13728aa87/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.270979 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ad8ffdf11c4701a47be49c2364b276, user_id=e65a266892ec4f25abbf4fa13728aa87, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.273984 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.288094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1410/2807] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:28 2022] PUT /identity/v3/projects/e7ad8ffdf11c4701a47be49c2364b276/users/e65a266892ec4f25abbf4fa13728aa87/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:28.292407 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.303161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b299-6e73-45d9-b979-f422a085b96d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.369351 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.369975 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.370250 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.370544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.371242 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.372819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aa454-815a-499f-a78d-5f2683037971 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.383857 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1398/2808] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:28.389783 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.400649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c0e0f-369e-41e9-9e81-d604277e60c8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.405772 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.406429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.406707 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.406974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] PATH_INFO: `/v3/projects/e7ad8ffdf11c4701a47be49c2364b276/users/e65a266892ec4f25abbf4fa13728aa87/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.408982 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ad8ffdf11c4701a47be49c2364b276, user_id=e65a266892ec4f25abbf4fa13728aa87, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.411654 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.423159 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1411/2809] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:28 2022] PUT /identity/v3/projects/e7ad8ffdf11c4701a47be49c2364b276/users/e65a266892ec4f25abbf4fa13728aa87/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:28.436769 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.437188 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.437603 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.471732 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] MFA Rules not processed for user `e65a266892ec4f25abbf4fa13728aa87`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:28.472963 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:28.547140 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1399/2810] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:28.560365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.562492 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:28.621149 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288a5c-f8bb-4661-8ea1-47a536d7fcae admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.626694 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.627604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.628024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.628429 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.642856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.644347 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.654272 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1412/2811] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:28.711794 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:28.713280 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:28.726454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3397e0-18d6-4302-b474-b3fbbab5283c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:28.730920 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:28.731581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:28.731871 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:28.732138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:28.742754 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:28.793256 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:28.794684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568f9d3-a22c-4072-9b0d-1ddb62aa5bef service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:28.803889 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1400/2812] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:32.212278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:32.277247 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c289-31c3-4436-ba87-c640c0adb9d0 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:32.284626 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:32.285569 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:32.285890 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:32.286216 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] PATH_INFO: `/v3/users/b3ee8f0a7f304a94b93c801ea991dd6f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:32.288059 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ee8f0a7f304a94b93c801ea991dd6f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:32.290908 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:32.343212 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ee8f0a7f304a94b93c801ea991dd6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.343858 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ee8f0a7f304a94b93c801ea991dd6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.344500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ee8f0a7f304a94b93c801ea991dd6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.345714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:32.353031 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ee8f0a7f304a94b93c801ea991dd6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.365198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ee8f0a7f304a94b93c801ea991dd6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.385917 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1413/2813] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:32 2022] DELETE /identity/v3/users/b3ee8f0a7f304a94b93c801ea991dd6f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:32.391377 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:32.391896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:32.391896 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:32.413082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:32.414320 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:32.484582 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1401/2814] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:32.494975 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:32.496814 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:32.558624 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6324bf-a8d7-4734-896b-d0d9a8a0a519 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:32.562727 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:32.563490 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:32.563771 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:32.564041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:32.579367 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:32.581587 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:32.595921 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1414/2815] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:32.885850 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:32.887451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:32.899864 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4600522-f1fd-4d1f-bd5e-a5f09f868488 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:32.904691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:32.905319 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:32.905591 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:32.905870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] PATH_INFO: `/v3/projects/15562659fec94b15861552aded1c0c41` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:32.907020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=15562659fec94b15861552aded1c0c41)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:32.908970 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:32.958474 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15562659fec94b15861552aded1c0c41', 'request_id': 'req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.965035 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15562659fec94b15861552aded1c0c41', 'request_id': 'req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.975483 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15562659fec94b15861552aded1c0c41', 'request_id': 'req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.986231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] The token cache is being invalidate because project 15562659fec94b15861552aded1c0c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:32.986535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.987156 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:32.988707 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1402/2816] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:32 2022] DELETE /identity/v3/projects/15562659fec94b15861552aded1c0c41 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:45:32.992746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:33.002825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0ff4-5577-4bdf-a5fa-29cc5dc0a70f service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:33.075864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:33.076435 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.076712 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.076992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] PATH_INFO: `/v3/users/e65a266892ec4f25abbf4fa13728aa87` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.078152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65a266892ec4f25abbf4fa13728aa87)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:33.080288 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:33.132201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65a266892ec4f25abbf4fa13728aa87'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.133279 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65a266892ec4f25abbf4fa13728aa87'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.134233 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65a266892ec4f25abbf4fa13728aa87'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.142640 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65a266892ec4f25abbf4fa13728aa87'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.153431 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:33.156192 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8e87a67b-31a8-4527-a62b-bf5b581d043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65a266892ec4f25abbf4fa13728aa87'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.173302 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1415/2817] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:32 2022] DELETE /identity/v3/users/e65a266892ec4f25abbf4fa13728aa87 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:33.468902 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:33.471273 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:33.491223 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a52cc-66d2-4c69-93fc-e6c5345a0faa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:33.529196 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:33.556194 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:33.556841 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.557112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.557378 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] PATH_INFO: `/v3/projects/e7ad8ffdf11c4701a47be49c2364b276` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.558519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ad8ffdf11c4701a47be49c2364b276)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:33.560451 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:33.609770 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ad8ffdf11c4701a47be49c2364b276', 'request_id': 'req-06c22932-b893-4b4f-97ad-e2120bfd0bcd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.615949 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ad8ffdf11c4701a47be49c2364b276', 'request_id': 'req-06c22932-b893-4b4f-97ad-e2120bfd0bcd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.625915 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ad8ffdf11c4701a47be49c2364b276', 'request_id': 'req-06c22932-b893-4b4f-97ad-e2120bfd0bcd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.636932 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] The token cache is being invalidate because project e7ad8ffdf11c4701a47be49c2364b276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:33.637239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.637933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-06c22932-b893-4b4f-97ad-e2120bfd0bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:33.639535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1403/2818] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:33 2022] DELETE /identity/v3/projects/e7ad8ffdf11c4701a47be49c2364b276 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:33.645904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.646422 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.646549 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.672181 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:33.673464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:33.736228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1416/2819] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:45:33.744609 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.744894 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.745181 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.766234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:33.767677 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:33.779379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1404/2820] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:33.784152 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:33.800974 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46ca12-57c3-4b13-9940-70b565121f5b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:33.806989 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:33.807627 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.807897 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.808157 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.808802 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:45:33.809093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:33.810689 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:33.823905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1417/2821] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:45:33.828800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:33.837962 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dfe59-45d3-414e-bf70-140bda48aab0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:33.842875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:33.843499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.843783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.844062 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.844703 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:33.846587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:33.875413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1405/2822] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:33 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:33.881926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:33.895903 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554265-ccaf-455b-a1d6-719db1a2f8b2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:33.970117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:33.970736 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:33.971015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:33.971320 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:33.971955 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:33.973884 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.001517 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1418/2823] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:33 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:34.006137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.016876 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2441a-0c1f-4809-a83c-2523dc160759 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.022608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.023308 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.023583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.023892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.024520 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.026112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.036562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1406/2824] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:34.041072 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.052163 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce2550-8ef3-45c6-93ea-23b5638f963e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.058572 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.059177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.059483 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.059752 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.060399 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.062002 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57b2b0-4086-4bf5-bec2-efb403a215f9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.073205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1419/2825] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:34.077434 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.088172 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beafd1-5451-4dba-a4c4-8ea0afbc4508 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.094167 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.094823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.095098 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.095416 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] PATH_INFO: `/v3/projects/4173aa29367948fd889464d5c21bec2e/users/93ee1c8396b34ed48e4d02a3a7e205c9/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.110299 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4173aa29367948fd889464d5c21bec2e, user_id=93ee1c8396b34ed48e4d02a3a7e205c9, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.112988 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.127700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1407/2826] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:34 2022] PUT /identity/v3/projects/4173aa29367948fd889464d5c21bec2e/users/93ee1c8396b34ed48e4d02a3a7e205c9/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:34.138194 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.138477 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.138753 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.168301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] MFA Rules not processed for user `93ee1c8396b34ed48e4d02a3a7e205c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:34.169511 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:34.215961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:34.241649 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1420/2827] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:34.247085 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.320938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f9375-fae6-40d5-9a15-b365615dc357 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.327001 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.327637 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.327916 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.328186 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.328844 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.330746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.336515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:34.360144 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1408/2828] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:34 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:34.364473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.375797 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e92f3e-8056-41e2-b217-27e957e38ead None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.435809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.436438 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.436718 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.436992 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.437671 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.439645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.462674 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1421/2829] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:34 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:45:34.466758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.481302 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c19ed-75aa-4390-92bb-2709282b5dd7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.486353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.486991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.487296 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.487565 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.488212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.489836 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.500248 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1409/2830] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:34.504725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.515278 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7940d-06a9-415e-91f8-af64a5585634 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.521017 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.521692 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.521965 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.522229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] PATH_INFO: `/v3/projects/fecfcbcc39f34c34919fd66544df09ea/users/b49f55f7442f4fee96be70c945348c0c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.537348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecfcbcc39f34c34919fd66544df09ea, user_id=b49f55f7442f4fee96be70c945348c0c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.540036 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.558028 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1422/2831] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:34 2022] PUT /identity/v3/projects/fecfcbcc39f34c34919fd66544df09ea/users/b49f55f7442f4fee96be70c945348c0c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:34.563041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.573682 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03540-7925-4ea5-8362-3cd643ddacca admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.639390 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.640011 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.640290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.640581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.641389 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.643106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e3ae4-7714-4aa3-967b-c8bdfd36a426 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.653298 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1410/2832] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:34.657786 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.673845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78769bc-08ff-4958-80ba-c26ff1eb530c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.683737 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.684679 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.685004 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.685271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] PATH_INFO: `/v3/projects/fecfcbcc39f34c34919fd66544df09ea/users/b49f55f7442f4fee96be70c945348c0c/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.687816 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecfcbcc39f34c34919fd66544df09ea, user_id=b49f55f7442f4fee96be70c945348c0c, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.690559 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.703833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1423/2833] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:34 2022] PUT /identity/v3/projects/fecfcbcc39f34c34919fd66544df09ea/users/b49f55f7442f4fee96be70c945348c0c/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:34.715923 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683024-e0be-4b46-9626-502c075956ad None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.716243 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683024-e0be-4b46-9626-502c075956ad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.716549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683024-e0be-4b46-9626-502c075956ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.745088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f5683024-e0be-4b46-9626-502c075956ad None None] MFA Rules not processed for user `b49f55f7442f4fee96be70c945348c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:34.746325 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5683024-e0be-4b46-9626-502c075956ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:34.815870 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1411/2834] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:34.826735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:34.828742 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:34.888714 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087192ea-e33a-440e-a3f0-7f2e88a7f802 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:34.892904 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:34.893529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:34.893801 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:34.894066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:34.904083 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:34.905519 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d11b4-4fe7-4a4a-a96d-f651b3a61350 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:34.915215 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1424/2835] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:35.061670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5683024-e0be-4b46-9626-502c075956ad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:35.121100 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:35.126205 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5683024-e0be-4b46-9626-502c075956ad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:35.132303 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:35.132938 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:35.133212 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:35.133475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] PATH_INFO: `/v3/users/93ee1c8396b34ed48e4d02a3a7e205c9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:35.134620 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ee1c8396b34ed48e4d02a3a7e205c9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:35.136576 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:35.186858 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ee1c8396b34ed48e4d02a3a7e205c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.187571 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ee1c8396b34ed48e4d02a3a7e205c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.188241 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ee1c8396b34ed48e4d02a3a7e205c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.204178 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ee1c8396b34ed48e4d02a3a7e205c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.211989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ee1c8396b34ed48e4d02a3a7e205c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.227521 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1412/2836] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:35 2022] DELETE /identity/v3/users/93ee1c8396b34ed48e4d02a3a7e205c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:35.232284 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:35.232570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:35.232840 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:35.253097 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:35.254348 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:35.291437 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:35.321675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1425/2837] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:35.331961 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:35.333496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:35.393217 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec693720-e01d-419e-a831-409dc92413a6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:35.397369 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:35.397985 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:35.398279 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:35.398549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:35.408540 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:35.410322 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:35.420846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1413/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:35.701479 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:35.702997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:35.717041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76f31-ce49-41cb-b14e-c81b38108429 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:35.722142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:35.723420 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:35.723866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:35.724143 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] PATH_INFO: `/v3/projects/4173aa29367948fd889464d5c21bec2e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:35.725301 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4173aa29367948fd889464d5c21bec2e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:35.727184 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:35.776494 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4173aa29367948fd889464d5c21bec2e', 'request_id': 'req-dc612c97-f6e7-4a9e-a001-3e29501711c8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.782766 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4173aa29367948fd889464d5c21bec2e', 'request_id': 'req-dc612c97-f6e7-4a9e-a001-3e29501711c8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.793145 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4173aa29367948fd889464d5c21bec2e', 'request_id': 'req-dc612c97-f6e7-4a9e-a001-3e29501711c8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.803390 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] The token cache is being invalidate because project 4173aa29367948fd889464d5c21bec2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:35.803678 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.804297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.806175 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1426/2839] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:35 2022] DELETE /identity/v3/projects/4173aa29367948fd889464d5c21bec2e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:35.810290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:35.820917 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b26c0-df15-48e4-9f8c-1d878c06b421 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:35.890901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:35.891730 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:35.892057 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:35.892300 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] PATH_INFO: `/v3/users/b49f55f7442f4fee96be70c945348c0c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:35.893413 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49f55f7442f4fee96be70c945348c0c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:35.895464 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:35.917384 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:35.943972 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49f55f7442f4fee96be70c945348c0c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.944762 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49f55f7442f4fee96be70c945348c0c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.945527 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49f55f7442f4fee96be70c945348c0c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.957708 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49f55f7442f4fee96be70c945348c0c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.964695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e698cea7-66da-494c-a537-034c8cb7d2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49f55f7442f4fee96be70c945348c0c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:35.981114 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1414/2840] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:35 2022] DELETE /identity/v3/users/b49f55f7442f4fee96be70c945348c0c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:36.286591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.288257 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:36.306463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612c97-f6e7-4a9e-a001-3e29501711c8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.369009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.369556 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.369828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.370093 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] PATH_INFO: `/v3/projects/fecfcbcc39f34c34919fd66544df09ea` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.371314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecfcbcc39f34c34919fd66544df09ea)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.373277 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.420051 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecfcbcc39f34c34919fd66544df09ea', 'request_id': 'req-341109c1-9d56-42e0-9e3b-5abcd3ae0533'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:36.426628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecfcbcc39f34c34919fd66544df09ea', 'request_id': 'req-341109c1-9d56-42e0-9e3b-5abcd3ae0533'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:36.436933 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecfcbcc39f34c34919fd66544df09ea', 'request_id': 'req-341109c1-9d56-42e0-9e3b-5abcd3ae0533'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:36.439160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:36.449416 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] The token cache is being invalidate because project fecfcbcc39f34c34919fd66544df09ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:36.449700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:36.450372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-341109c1-9d56-42e0-9e3b-5abcd3ae0533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:36.451902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1427/2841] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:36 2022] DELETE /identity/v3/projects/fecfcbcc39f34c34919fd66544df09ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:36.456856 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.457141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.457414 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.477436 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:36.478686 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:36.549340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1415/2842] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:36.557758 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.558092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.558339 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.589085 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:36.590997 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:36.602809 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1428/2843] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:36.607542 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.617887 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cfeba-6b82-4f3a-ab61-f473cb645866 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.623518 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.624082 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.624338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.624615 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.625258 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:45:36.625562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.627175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.640051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1416/2844] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:45:36.644964 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.654400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c098-a0f6-4ed8-a70d-c491ec329c31 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.659725 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.660365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.660642 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.660911 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.661542 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.663635 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.700571 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1429/2845] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:36 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:36.705199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.716646 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9987262-ea08-4da8-aafc-4af3149b4c38 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.774047 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.774674 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.774954 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.775230 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.775884 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.778049 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.800924 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1417/2846] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:36 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:36.805388 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.816365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173072-7f91-4b63-b436-fd17532c56a2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.821722 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.822323 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.822598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.822848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.823538 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.825137 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.835142 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1430/2847] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:36.840549 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.850601 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883416-5343-40dd-bb07-86098f184aae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.855688 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.856287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.856555 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.856824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.857465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.859051 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504417-a49e-4617-93a7-96a8213252e0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.869724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1418/2848] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:36.874127 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:36.884590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46b418-95ac-438c-906d-da07be4c55f5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:36.890094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:36.890746 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.891086 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.891396 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] PATH_INFO: `/v3/projects/ac2467675f214e9b86dc8890a93d8dde/users/d4dd037114944a3f9a8b271d64cb5954/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.906680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2467675f214e9b86dc8890a93d8dde, user_id=d4dd037114944a3f9a8b271d64cb5954, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:36.909445 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:36.924767 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1431/2849] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:36 2022] PUT /identity/v3/projects/ac2467675f214e9b86dc8890a93d8dde/users/d4dd037114944a3f9a8b271d64cb5954/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:36.935559 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:36.935843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:36.936111 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:36.944379 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:36.964587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] MFA Rules not processed for user `d4dd037114944a3f9a8b271d64cb5954`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:36.965817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:37.030282 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1419/2850] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:37.035117 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.100026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbf076-0977-49cf-af6f-15f2749fd679 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.105255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.105875 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.106148 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.106417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.107041 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.108976 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.144251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1432/2851] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:37 2022] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:37.148888 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.162106 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0fe38-675f-4f95-a8ed-801e32806f32 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.219024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.219734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.220014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.220286 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.220910 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.222852 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.251287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1420/2852] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:37 2022] POST /identity/v3/users => generated 310 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:37.257254 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.270847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c71520-f5b4-4b10-8f66-ef2fb9178195 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.276160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.276832 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.277205 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.277540 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.278402 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.280128 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.291372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1433/2853] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:37.297643 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.308701 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7817e-161a-4678-8cf3-b20907442367 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.314402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.315071 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.315394 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.315666 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] PATH_INFO: `/v3/projects/3c9f688724534fffa2dbb43b809a021c/users/55e02e8e603249c09f25a676c376f7d4/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.331742 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9f688724534fffa2dbb43b809a021c, user_id=55e02e8e603249c09f25a676c376f7d4, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.334454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.357869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1421/2854] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:37 2022] PUT /identity/v3/projects/3c9f688724534fffa2dbb43b809a021c/users/55e02e8e603249c09f25a676c376f7d4/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 19:45:37.362561 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.376008 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a87ce3-2379-4a8a-accb-0caf05c644bf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.439623 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.440262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.440560 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.440827 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.441480 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.443104 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d301569-e4a8-4a69-a6e6-0eb6dbcb9857 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.445293 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:37.455376 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1434/2855] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:37.459141 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.469892 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6348d8-83d1-46c4-a652-50f7889f131b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.475000 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.475700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.475980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.476252 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] PATH_INFO: `/v3/projects/3c9f688724534fffa2dbb43b809a021c/users/55e02e8e603249c09f25a676c376f7d4/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.478155 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9f688724534fffa2dbb43b809a021c, user_id=55e02e8e603249c09f25a676c376f7d4, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.480834 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.491602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1422/2856] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:37 2022] PUT /identity/v3/projects/3c9f688724534fffa2dbb43b809a021c/users/55e02e8e603249c09f25a676c376f7d4/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:37.559523 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.559961 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.560418 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.599478 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] MFA Rules not processed for user `55e02e8e603249c09f25a676c376f7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:37.600830 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:37.676352 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1435/2857] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:37.691869 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.693632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:37.748583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:37.756021 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17eb45-9878-4a39-aa2d-a97c482f1531 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.760927 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.761465 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.761740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.762010 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:37.771519 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:37.772958 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:37.782587 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1423/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:37.957594 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:37.972294 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa54f0-f587-448c-8773-0b4853e1049f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:37.976956 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:37.977563 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:37.977824 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:37.978101 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:38.038620 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:38.040111 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055eb55-8674-4afe-a23d-1d680a747d36 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:38.049576 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1436/2859] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:37 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:43.421593 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:43.486845 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebe7cc-9bf2-43b2-bc82-6030e6af939e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:43.491907 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:43.492544 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:43.492817 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:43.493088 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] PATH_INFO: `/v3/users/d4dd037114944a3f9a8b271d64cb5954` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:43.494329 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dd037114944a3f9a8b271d64cb5954)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:43.496332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:43.551937 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dd037114944a3f9a8b271d64cb5954'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:43.552602 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dd037114944a3f9a8b271d64cb5954'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:43.553226 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dd037114944a3f9a8b271d64cb5954'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:43.565236 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dd037114944a3f9a8b271d64cb5954'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:43.572287 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dd037114944a3f9a8b271d64cb5954'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:43.588118 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1424/2860] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:43 2022] DELETE /identity/v3/users/d4dd037114944a3f9a8b271d64cb5954 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:43.594486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:43.594985 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:43.595262 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:43.616486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:43.617700 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:43.688646 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1437/2861] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:43.700517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:43.702124 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:43.767253 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbe38-3b9c-4c9d-bdc7-fcfd72822a5d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:43.771353 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:43.771964 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:43.772233 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:43.772499 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:43.783255 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:43.784724 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:43.794775 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1425/2862] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:44.077351 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:44.078914 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:44.094015 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970049-20d3-4bc8-a5b1-2642f996fd90 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:44.103228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:44.103228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.103228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.103228 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] PATH_INFO: `/v3/projects/ac2467675f214e9b86dc8890a93d8dde` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.104135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2467675f214e9b86dc8890a93d8dde)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:44.104135 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:44.120638 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=100 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:44.151221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2467675f214e9b86dc8890a93d8dde', 'request_id': 'req-ea2198c7-8396-4c22-9e4c-5255e5b893ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.157473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2467675f214e9b86dc8890a93d8dde', 'request_id': 'req-ea2198c7-8396-4c22-9e4c-5255e5b893ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.166173 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2467675f214e9b86dc8890a93d8dde', 'request_id': 'req-ea2198c7-8396-4c22-9e4c-5255e5b893ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.176828 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] The token cache is being invalidate because project ac2467675f214e9b86dc8890a93d8dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:44.177177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.177777 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.179349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1438/2863] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:44 2022] DELETE /identity/v3/projects/ac2467675f214e9b86dc8890a93d8dde => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:44.183837 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:44.193432 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e190a-7078-4add-9d28-ea9c36d593a8 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:44.201284 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:44.250475 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:44.251120 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.251412 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.251755 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] PATH_INFO: `/v3/users/55e02e8e603249c09f25a676c376f7d4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.252951 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e02e8e603249c09f25a676c376f7d4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:44.254803 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:44.303147 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e02e8e603249c09f25a676c376f7d4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.303846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e02e8e603249c09f25a676c376f7d4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.304455 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e02e8e603249c09f25a676c376f7d4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.320976 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e02e8e603249c09f25a676c376f7d4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.328918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea02cf65-8a51-4b7e-a345-75f85a5f4f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e02e8e603249c09f25a676c376f7d4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.345034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1426/2864] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:44 2022] DELETE /identity/v3/users/55e02e8e603249c09f25a676c376f7d4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:44.641902 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:44.643452 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:44.657691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2198c7-8396-4c22-9e4c-5255e5b893ef admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:44.731355 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:44.732251 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.732588 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.732857 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] PATH_INFO: `/v3/projects/3c9f688724534fffa2dbb43b809a021c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.734586 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9f688724534fffa2dbb43b809a021c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:44.737491 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:44.787461 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9f688724534fffa2dbb43b809a021c', 'request_id': 'req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.794356 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9f688724534fffa2dbb43b809a021c', 'request_id': 'req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.803577 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9f688724534fffa2dbb43b809a021c', 'request_id': 'req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.814855 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] The token cache is being invalidate because project 3c9f688724534fffa2dbb43b809a021c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:44.815140 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.815842 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9fc71beb-ecc9-4eb1-9e0f-30c12823302e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:44.817424 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1439/2865] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:44 2022] DELETE /identity/v3/projects/3c9f688724534fffa2dbb43b809a021c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:44.822748 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.823328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.823328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.843161 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:44.844422 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:44.903723 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1427/2866] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:44.911598 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.911883 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.912195 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.932882 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:44.934094 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:44.942276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1440/2867] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:44.946759 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:44.956562 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c290f-d61e-4daf-94a3-7ac5d6e32211 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:44.961494 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:44.962094 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:44.962374 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:44.962650 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:44.963331 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:45:44.963640 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:44.965267 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:44.977170 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1428/2868] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 19:45:44.982168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:44.995800 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd3cf-0059-4980-a210-5e4f55935694 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.000790 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.001338 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.001606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.001905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.002500 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.004643 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.034805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1441/2869] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:44 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 19:45:45.039746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.050484 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca04074-dace-4b56-a211-0fa9e3de5704 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.065830 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:45.119784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.120485 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.120833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.121130 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.122038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.125025 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.151767 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1429/2870] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:45 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:45.157924 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.169819 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931dff-83ee-4178-b3c7-b5467a54848c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.175591 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.176314 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.176593 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.176863 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.177513 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.179151 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.180850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:45.191146 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1442/2871] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:45.195482 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.206199 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635b3d-a5c6-48f8-8cb2-d07b8c6e7dff admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.211473 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.212066 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.212338 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.212612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.213283 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.214873 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c83c0d-11a0-4995-a60f-2fb253f30f78 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.225418 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1430/2872] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:45.229750 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.239923 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850e23-650c-434e-8260-e6e7e59254f4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.244889 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.245544 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.245825 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.246095 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] PATH_INFO: `/v3/projects/c1b77d7ee82747b599750f62fc1c549d/users/6e2631d377aa4bb597edac01890a1019/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.265074 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b77d7ee82747b599750f62fc1c549d, user_id=6e2631d377aa4bb597edac01890a1019, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.268778 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.285125 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1443/2873] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:45 2022] PUT /identity/v3/projects/c1b77d7ee82747b599750f62fc1c549d/users/6e2631d377aa4bb597edac01890a1019/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:45.297496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.297784 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.298056 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.330016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] MFA Rules not processed for user `6e2631d377aa4bb597edac01890a1019`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:45.331269 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:45.395792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1431/2874] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:45.400672 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.471007 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b32b1-9a14-4332-b961-6bc82a01c0b6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.476044 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.476658 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.477069 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.477250 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.477900 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.479850 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.511529 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1444/2875] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:45 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:45.516672 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.528093 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8f46-31a0-4d7a-9608-96d4c4eaac36 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.585038 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.585654 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.585933 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.586263 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.586819 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.588800 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.612081 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1432/2876] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:45 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:45.616373 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.626938 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98b036-14ac-4431-b238-ae250c3e44c2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.632022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.632621 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.632905 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.633201 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.633846 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.635473 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.646229 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1445/2877] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:45.651003 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.667301 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ca38-8e2b-4dc2-a71c-ff5a354ecdd3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.675973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.676918 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.677274 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.677594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] PATH_INFO: `/v3/projects/b6ab12a6819f427ebc44903414fe979a/users/69008db0f9f946a1bc440b8d4c599c2b/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.693332 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:45.697153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab12a6819f427ebc44903414fe979a, user_id=69008db0f9f946a1bc440b8d4c599c2b, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.699901 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.715462 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1433/2878] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:45 2022] PUT /identity/v3/projects/b6ab12a6819f427ebc44903414fe979a/users/69008db0f9f946a1bc440b8d4c599c2b/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:45.719548 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.729793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d35704-6e9d-41e2-9c63-1ebd71587c44 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.789514 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.790131 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.790404 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.790673 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.791363 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.792957 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903442d-7e25-46a7-90dd-bfdbb68232bd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.802764 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1446/2879] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:45.808229 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.824079 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5697-811b-40ff-9afe-3ef49a362817 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:45.831792 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:45.832454 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.832751 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.833013 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] PATH_INFO: `/v3/projects/b6ab12a6819f427ebc44903414fe979a/users/69008db0f9f946a1bc440b8d4c599c2b/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.835831 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab12a6819f427ebc44903414fe979a, user_id=69008db0f9f946a1bc440b8d4c599c2b, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:45.838489 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:45.850713 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1434/2880] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:45 2022] PUT /identity/v3/projects/b6ab12a6819f427ebc44903414fe979a/users/69008db0f9f946a1bc440b8d4c599c2b/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:45.861189 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:45.861472 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:45.861761 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:45.889423 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] MFA Rules not processed for user `69008db0f9f946a1bc440b8d4c599c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:45.890645 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:45.920106 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:45.966381 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1447/2881] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:45.977684 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:45.979645 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:46.046077 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad744-c965-4927-a9fd-97dce9d9989a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:46.050397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:46.051014 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:46.051327 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:46.051595 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:46.062083 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:46.063547 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2692f2-86f8-4e80-90f4-fb20ecddca19 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:46.073687 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1435/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:46.654787 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:46.728873 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749ae9-593b-49f2-a676-59c64a60c7f6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:46.733486 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:46.734124 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:46.734397 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:46.734662 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] PATH_INFO: `/v3/users/6e2631d377aa4bb597edac01890a1019` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:46.735799 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2631d377aa4bb597edac01890a1019)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:46.737713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:46.788628 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2631d377aa4bb597edac01890a1019'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:46.789464 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2631d377aa4bb597edac01890a1019'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:46.790160 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2631d377aa4bb597edac01890a1019'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:46.797335 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2631d377aa4bb597edac01890a1019'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:46.809589 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2631d377aa4bb597edac01890a1019'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:46.824495 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1448/2883] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:46 2022] DELETE /identity/v3/users/6e2631d377aa4bb597edac01890a1019 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:46.829359 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:46.829860 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:46.829973 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:46.849517 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:46.850726 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:46.910340 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1436/2884] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:46.922341 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:46.924026 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:46.983081 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:46.991349 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3a69-89a7-4467-b163-498b9a30aa70 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:46.996221 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:46.996848 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:46.997136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:46.997413 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:47.006896 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:47.008380 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:47.018024 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1449/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:47.301435 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:47.302982 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:47.316153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cac88-88ff-43bb-90a7-5f490855aa5a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:47.321433 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:47.322234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:47.322600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:47.322926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] PATH_INFO: `/v3/projects/c1b77d7ee82747b599750f62fc1c549d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:47.324316 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b77d7ee82747b599750f62fc1c549d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:47.326628 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:47.375388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b77d7ee82747b599750f62fc1c549d', 'request_id': 'req-b4b18964-87b1-46e9-be21-81f2f07b54e0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.381539 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b77d7ee82747b599750f62fc1c549d', 'request_id': 'req-b4b18964-87b1-46e9-be21-81f2f07b54e0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.390642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b77d7ee82747b599750f62fc1c549d', 'request_id': 'req-b4b18964-87b1-46e9-be21-81f2f07b54e0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.401734 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] The token cache is being invalidate because project c1b77d7ee82747b599750f62fc1c549d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:47.402016 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.402630 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.404132 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1437/2886] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:47 2022] DELETE /identity/v3/projects/c1b77d7ee82747b599750f62fc1c549d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:47.408265 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:47.418003 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96221630-0523-45c1-ad8c-a8c67d599cf7 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:47.478869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:47.479565 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:47.479845 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:47.480116 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] PATH_INFO: `/v3/users/69008db0f9f946a1bc440b8d4c599c2b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:47.481306 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69008db0f9f946a1bc440b8d4c599c2b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:47.483289 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:47.532065 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69008db0f9f946a1bc440b8d4c599c2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.532735 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69008db0f9f946a1bc440b8d4c599c2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.533353 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69008db0f9f946a1bc440b8d4c599c2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.540612 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69008db0f9f946a1bc440b8d4c599c2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.553836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76bf2068-3d3c-47c6-b6fb-d5503b374e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69008db0f9f946a1bc440b8d4c599c2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:47.568864 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1450/2887] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:47 2022] DELETE /identity/v3/users/69008db0f9f946a1bc440b8d4c599c2b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:47.872897 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:47.874380 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:47.891137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:47.895833 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b18964-87b1-46e9-be21-81f2f07b54e0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:47.957458 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:47.958097 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:47.958363 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:47.958608 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] PATH_INFO: `/v3/projects/b6ab12a6819f427ebc44903414fe979a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:47.959824 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ab12a6819f427ebc44903414fe979a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:47.961921 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.040891 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ab12a6819f427ebc44903414fe979a', 'request_id': 'req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:48.047105 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ab12a6819f427ebc44903414fe979a', 'request_id': 'req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:48.056843 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ab12a6819f427ebc44903414fe979a', 'request_id': 'req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:48.067239 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] The token cache is being invalidate because project b6ab12a6819f427ebc44903414fe979a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:48.067531 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:48.068137 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce5f1d71-2d92-4539-8da5-3dfe8d78f712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:48.069624 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1438/2888] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:47 2022] DELETE /identity/v3/projects/b6ab12a6819f427ebc44903414fe979a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:48.074726 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.075276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.075276 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.095590 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:48.096843 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:48.168243 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1451/2889] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:48.176028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.176312 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.176583 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.197112 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:48.198355 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:48.206568 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1439/2890] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 19:45:48.210821 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.220604 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880833a-55c8-49b5-9cdf-521454e89667 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.225319 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.225920 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.226226 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.226449 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.227168 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 19:45:48.227498 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.229092 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.231463 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:48.242996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1452/2891] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Aug 7 19:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 19:45:48.246581 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.256537 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f0e0-7891-4640-9d4c-654b7a6cfe2e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.261875 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.262488 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.262758 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.263020 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.263695 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.265600 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.295036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1440/2892] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:48.299469 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.309991 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a834-4ae3-49a9-b3d5-c94b71d0013f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.372951 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.373570 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.373847 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.374113 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.374733 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.376713 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.401255 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1453/2893] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:48.407261 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.418443 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef351c-e770-4b3e-be4f-47692f788913 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.423490 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.424388 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.424667 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.424926 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.425594 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.427232 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.440041 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1441/2894] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:48.444249 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.454681 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485f16d-8119-4a24-bcb3-db63eb5bf92e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.459668 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.460271 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.460541 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.460836 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.461555 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.463158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cd98a-e76c-4d56-9775-62c30b14f8a6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.473838 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1454/2895] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:48.478669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.493823 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7225-be0b-4ec7-8418-d92945f253dc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.499691 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.500361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.500629 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.500899 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] PATH_INFO: `/v3/projects/0ae7d01ae45a4f5897b60d13b8ee6e5f/users/74aa024246734c7aaa7e38c0e7397272/roles/a8ae165c6ef74b2d8d474682dc303304` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.516752 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae7d01ae45a4f5897b60d13b8ee6e5f, user_id=74aa024246734c7aaa7e38c0e7397272, role_id=a8ae165c6ef74b2d8d474682dc303304)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.519429 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.539034 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1442/2896] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:48 2022] PUT /identity/v3/projects/0ae7d01ae45a4f5897b60d13b8ee6e5f/users/74aa024246734c7aaa7e38c0e7397272/roles/a8ae165c6ef74b2d8d474682dc303304 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:48.556717 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.556946 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.557154 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.586485 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] MFA Rules not processed for user `74aa024246734c7aaa7e38c0e7397272`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:48.587740 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:48.658223 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1455/2897] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:48.664176 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.699655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:48.730655 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4aab2-ac75-44eb-8c1e-ee43efad5cbf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.735879 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.736496 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.736763 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.737028 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.737642 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.739570 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.767626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1443/2898] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:48.771796 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.783400 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3c27-ac8c-42be-9ec5-d70dd99bd931 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.842303 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.842833 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.843114 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.843426 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.844067 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.845996 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.856198 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:48.870484 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1456/2899] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Aug 7 19:45:48 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 19:45:48.874740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.885306 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0e11-79e1-409f-aeb7-15376ac736c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.890179 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.890783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.891063 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.891373 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.892024 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.893632 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.905950 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1444/2900] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:48.911009 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.924959 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5283d-9813-4f3e-8cc7-e382d4bd8828 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:48.931022 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:48.931734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:48.932032 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:48.932290 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] PATH_INFO: `/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d/users/7b99809319354dca9d70f3a4d81568ee/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:48.950016 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ebf1065abf4040a3cbe8514438cf3d, user_id=7b99809319354dca9d70f3a4d81568ee, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:48.952734 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:48.970048 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1457/2901] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:48 2022] PUT /identity/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d/users/7b99809319354dca9d70f3a4d81568ee/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:48.976467 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:48.987048 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641bfa-02ad-44a5-a72c-7e2d53e011c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:49.052619 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:49.053397 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:49.053783 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:49.054153 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:49.054914 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:49.057138 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858c5cf-068d-4e19-8da5-ac650b340f53 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:49.068746 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1445/2902] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Aug 7 19:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 19:45:49.073153 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:49.084805 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafb56-d429-49bf-a0f3-1d9c2e8ec332 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:49.090660 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:49.091444 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:49.091724 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:49.091998 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] PATH_INFO: `/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d/users/7b99809319354dca9d70f3a4d81568ee/roles/bdc7a74d6e874a13b6f1e0e814b94f46` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:49.096454 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ebf1065abf4040a3cbe8514438cf3d, user_id=7b99809319354dca9d70f3a4d81568ee, role_id=bdc7a74d6e874a13b6f1e0e814b94f46)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:49.100680 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:49.117616 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1458/2903] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Aug 7 19:45:49 2022] PUT /identity/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d/users/7b99809319354dca9d70f3a4d81568ee/roles/bdc7a74d6e874a13b6f1e0e814b94f46 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:49.128328 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:49.128612 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:49.128881 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:49.157969 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] MFA Rules not processed for user `7b99809319354dca9d70f3a4d81568ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:49.159174 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:49.230980 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1446/2904] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:49.242822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:49.244675 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:49.316867 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973e15-a66d-4ad8-a8d0-0339f147f50b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:49.321286 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad86d22df95d41c4b328c1e6c19381c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:49.321866 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:49.322177 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:49.322446 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:49.385868 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:49.387361 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a981e-cac0-4d8c-8d86-f79fdd34dd06 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:49.399317 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1459/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:51.978991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:52.011893 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:52.051908 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4fe30-e7b2-4ba7-9014-45ac517f22b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:52.057862 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:52.058515 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:52.058790 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:52.059059 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] PATH_INFO: `/v3/users/74aa024246734c7aaa7e38c0e7397272` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:52.060288 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74aa024246734c7aaa7e38c0e7397272)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:52.062234 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:52.115989 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74aa024246734c7aaa7e38c0e7397272'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.116712 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74aa024246734c7aaa7e38c0e7397272'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.117361 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74aa024246734c7aaa7e38c0e7397272'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.129090 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74aa024246734c7aaa7e38c0e7397272'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.135846 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74aa024246734c7aaa7e38c0e7397272'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.153756 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1447/2906] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:51 2022] DELETE /identity/v3/users/74aa024246734c7aaa7e38c0e7397272 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:52.158459 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:52.159066 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:52.159324 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:52.186372 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] MFA Rules not processed for user `3d7656c3347748588d850bcc8f38bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 19:45:52.190268 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:52.273853 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1460/2907] 10.222.0.15 () {58 vars in 958 bytes} [Sun Aug 7 19:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 19:45:52.284874 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:52.286441 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:52.346820 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bbd78-fcff-48d5-a315-f95f25ab8b11 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:52.350626 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec7f568319844b9fbd05f7936d439b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:52.351244 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:52.351553 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:52.351822 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:52.362500 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:52.363991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:52.374346 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1448/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:45:52.677158 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:52.678647 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:52.693075 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b332-7f1d-4a55-8c33-612eabff597e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:52.697869 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:52.698515 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:52.698792 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:52.699062 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] PATH_INFO: `/v3/projects/0ae7d01ae45a4f5897b60d13b8ee6e5f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:52.700793 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae7d01ae45a4f5897b60d13b8ee6e5f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:52.702887 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:52.710326 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:52.756211 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae7d01ae45a4f5897b60d13b8ee6e5f', 'request_id': 'req-1305e4e9-d203-4727-a573-d39e384bf7e0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.762683 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae7d01ae45a4f5897b60d13b8ee6e5f', 'request_id': 'req-1305e4e9-d203-4727-a573-d39e384bf7e0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.773417 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae7d01ae45a4f5897b60d13b8ee6e5f', 'request_id': 'req-1305e4e9-d203-4727-a573-d39e384bf7e0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.785691 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] The token cache is being invalidate because project 0ae7d01ae45a4f5897b60d13b8ee6e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:52.785891 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.786584 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.788155 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1461/2909] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:52 2022] DELETE /identity/v3/projects/0ae7d01ae45a4f5897b60d13b8ee6e5f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:52.793669 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:52.804036 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496af3-b17b-4d1f-8c97-95d5038dd8dd service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:52.850290 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:45:52.864616 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:52.865259 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:52.865535 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:52.865807 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] PATH_INFO: `/v3/users/7b99809319354dca9d70f3a4d81568ee` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:52.866979 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b99809319354dca9d70f3a4d81568ee)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:52.869061 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:52.919647 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b99809319354dca9d70f3a4d81568ee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.920478 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b99809319354dca9d70f3a4d81568ee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.921231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b99809319354dca9d70f3a4d81568ee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.934402 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b99809319354dca9d70f3a4d81568ee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.941670 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b99809319354dca9d70f3a4d81568ee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:52.956510 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1449/2910] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Aug 7 19:45:52 2022] DELETE /identity/v3/users/7b99809319354dca9d70f3a4d81568ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:45:53.252953 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:45:53.255120 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:45:53.272389 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305e4e9-d203-4727-a573-d39e384bf7e0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:45:53.333297 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d7656c3347748588d850bcc8f38bb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e527c3fb15634bdca3cbcaa63266edf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:45:53.333870 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:45:53.334141 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:45:53.334411 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] PATH_INFO: `/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:45:53.335614 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ebf1065abf4040a3cbe8514438cf3d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:45:53.337536 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:45:53.384606 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ebf1065abf4040a3cbe8514438cf3d', 'request_id': 'req-b83421ce-bb4c-4083-bd7c-610e372e1cf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:53.390822 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ebf1065abf4040a3cbe8514438cf3d', 'request_id': 'req-b83421ce-bb4c-4083-bd7c-610e372e1cf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:53.401136 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ebf1065abf4040a3cbe8514438cf3d', 'request_id': 'req-b83421ce-bb4c-4083-bd7c-610e372e1cf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:53.411926 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] The token cache is being invalidate because project c7ebf1065abf4040a3cbe8514438cf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 19:45:53.412202 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:53.412856 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b83421ce-bb4c-4083-bd7c-610e372e1cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 19:45:53.414365 dv-cinder-850320-4-smb devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1462/2911] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Aug 7 19:45:53 2022] DELETE /identity/v3/projects/c7ebf1065abf4040a3cbe8514438cf3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 19:46:02.952991 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:46:03.408806 dv-cinder-850320-4-smb devstack@keystone.service[80291]: DEBUG dbcounter [-] [80291] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 19:46:47.413481 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 19:46:47.415697 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:46:47.490978 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d9bf2-8425-4a11-841b-b95dfec60dcf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 19:46:47.552121 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f7750b5c4740b4bf56933e2c7bbfe5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88cbce51151848439e096043928ffb3b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 19:46:47.552740 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 19:46:47.553026 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 19:46:47.553660 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 19:46:47.555700 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 19:46:47.567231 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 19:46:47.569080 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b5ee-d9a9-422f-b31c-bf04e74f1095 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 19:46:47.580065 dv-cinder-850320-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1450/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Aug 7 19:46:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 19:46:57.575175 dv-cinder-850320-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=58 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}